00000001:02000400:1.0F:1788658138.716145:0:3300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_hostid 00000001:02000400:1.0:1788658161.734934:0:3524:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788658163.955843:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 583 MB/s 00000001:01000000:3.0F:1788658164.206387:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 683 MB/s 00000001:01000000:0.0F:1788658164.456400:0:3584:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4195 MB/s 00000020:02000000:0.0:1788658165.638980:0:3615:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g2c24a36 00000400:02000000:1.0:1788658166.635102:0:3630:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.153@tcp [8/256/0/180] 00008000:02000000:3.0:1788658170.569196:0:3780:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788658237.460030:0:5763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788658251.034929:0:6513:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788658251.034938:0:6513:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788658251.034940:0:6513:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788658251.035109:0:6513:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009c670b6f 00000080:02000400:3.0:1788658251.035123:0:6513:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788658251.042247:0:6513:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788658251.042266:0:6513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788658251.042411:0:6513:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000005b99770d) 00000020:00000080:3.0:1788658251.042437:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788658251.139811:0:6513:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788658251.139986:0:6513:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0F:1788658251.204663:0:6513:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788658251.205031:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788658251.205045:0:6513:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788658251.205063:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6e3ad 00000020:01000004:2.0:1788658251.205072:0:6513:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788658251.205079:0:6513:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788658251.205084:0:6513:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009c670b6f from MGS 00000020:01000004:2.0:1788658251.205090:0:6513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788658251.205113:0:6513:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a5fc19cf) 00000020:00000080:2.0:1788658251.205143:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788658251.205278:0:6513:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009c670b6f from MGS, refs=2 00080000:01000000:2.0:1788658251.205285:0:6513:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658251.205291:0:6513:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6e3bb 00000100:00100000:2.0:1788658251.205777:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788658251.205956:0:6513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788658251.205964:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788658251.207195:0:6513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788658251.207209:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788658251.212213:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658251.212656:0:6513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788658251.212665:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788658251.215581:0:6513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788658251.215601:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788658251.217095:0:6513:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788658251.217108:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788658251.218336:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658251.218342:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658251.218345:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658251.218738:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658251.218741:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658251.218743:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658251.219459:0:6513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788658251.224454:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788658251.469165:0:6513:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2987 MB/s 00000001:01000000:3.0:1788658251.719041:0:6513:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2611 MB/s 00000001:01000000:2.0:1788658251.970227:0:6513:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 442 MB/s 00000001:01000000:3.0:1788658252.221455:0:6513:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 689 MB/s 00080000:10000000:1.0:1788658252.231289:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:3.0:1788658252.232178:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788658252.247116:0:6513:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788658252.247827:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788658252.248083:0:6513:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788658252.248130:0:6513:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788658252.248385:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788658252.248418:0:6513:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788658252.249626:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658252.250306:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788658252.250318:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788658252.253281:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788658252.253296:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788658252.253933:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788658252.253941:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788658252.256316:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788658252.256353:0:6513:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.153@tcp' 00000020:01000004:3.0:1788658252.256355:0:6513:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788658252.256435:0:6513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.153@tcp (typ=mgc) 00000020:00000080:3.0:1788658252.256452:0:6513:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.153@tcp (000000004a9d9eff) 00000020:00000080:3.0:1788658252.256475:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788658252.256624:0:6513:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000052c2ddce@MGC192.168.202.153@tcp: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658252.256851:0:6513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.153@tcp-0 is initialized 00000040:01000000:3.0:1788658252.256859:0:6513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788658252.265665:0:6532:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788658252.268071:0:6534:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788658252.268146:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.153@tcp (uuid a017dcfd-fba9-49c7-bb83-f753e9511c6f) 00000020:00000080:3.0:1788658252.268178:0:6513:0:(genops.c:1385:class_connect()) connect: client a017dcfd-fba9-49c7-bb83-f753e9511c6f, cookie 0x48e67cc629c6e3c9 00000100:00080000:3.0:1788658252.268196:0:6513:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658252.268204:0:6513:0:(import.c:665:import_select_connection()) MGC192.168.202.153@tcp: import 0000000052c2ddce using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658252.268270:0:6513:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000db9ce8e7 x1875544025071744/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658252.268310:0:6513:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS 00000020:01000004:3.0:1788658252.268332:0:6513:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788658252.268361:0:6513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788658252.268379:0:6513:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000540cddbd) 00000020:00000080:3.0:1788658252.268394:0:6513:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788658252.269085:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db9ce8e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3646:1875544025071744:0@lo:250: 00000100:00100000:1.0:1788658252.269219:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658252.269314:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025071744 00000100:00100000:1.0:1788658252.269324:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025071744 00000100:00100000:1.0:1788658252.269371:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658252.269379:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1c21af8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875544025071744:12345-0@lo:250: 00010000:00080000:1.0:1788658252.269410:0:6529:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a017dcfd-fba9-49c7-bb83-f753e9511c6f@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:1.0:1788658252.269443:0:6529:0:(genops.c:1385:class_connect()) connect: client a017dcfd-fba9-49c7-bb83-f753e9511c6f, cookie 0x48e67cc629c6e3d7 00000100:00080000:1.0:1788658252.269657:0:6529:0:(import.c:65:import_set_state_nolock()) 0000000090022a67 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658252.272938:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1c21af8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:3646:x1875544025071744:12345-0@lo:250: Request processed in 377us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658252.272960:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658252.273458:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788658252.273476:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.153@tcp: connect to target with instance 0 00000100:00080000:0.0:1788658252.273487:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788658252.273494:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788658252.273499:0:3646:0:(import.c:65:import_set_state_nolock()) 0000000052c2ddce MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788658252.273503:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788658252.273508:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788658252.274914:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db9ce8e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3646:1875544025071744:0@lo:250: 00000100:00100000:0.0:1788658252.310147:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658252.310357:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788658252.310363:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788658252.319563:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788658252.319578:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788658252.324418:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788658252.324440:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788658252.328813:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658252.329001:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788658252.329007:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788658252.332251:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788658252.332283:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788658252.427110:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658252.427318:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788658252.427325:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788658252.436438:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788658252.436463:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788658252.451538:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658252.451864:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788658252.451871:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788658252.458325:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788658252.459277:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788658252.463470:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658252.465263:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788658252.465276:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788658252.471381:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788658252.471402:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788658252.479245:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658252.481090:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788658252.481122:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788658252.487554:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788658252.487589:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788658252.556333:0:6513:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658252.556881:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788658252.556890:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788658252.560827:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788658252.560849:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788658252.567162:0:6513:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788658252.567196:0:6513:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788658252.569583:0:6513:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788658252.569636:0:6513:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788658252.569653:0:6513:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788658252.569835:0:6513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788658252.569880:0:6513:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788658252.569885:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788658252.569887:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658252.569889:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658252.569890:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658252.569891:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658252.569893:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658252.569894:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658252.569896:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658252.569899:0:6513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658252.569900:0:6513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658252.569902:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658252.569904:0:6513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658252.569907:0:6513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788658252.569909:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658252.569911:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658252.569912:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658252.569913:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658252.569914:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658252.569916:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658252.569917:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658252.569918:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658252.569918:0:6513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658252.569919:0:6513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658252.569920:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658252.569920:0:6513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658252.569980:0:6513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788658252.570004:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c545524 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025071872:0@lo:253: 00000100:00100000:0.0:1788658252.570127:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658252.570201:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000008462ed37 going to sleep for 11 seconds 00000100:00100000:1.0:1788658252.570458:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025071872 00000100:00100000:1.0:1788658252.570469:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025071872 00000100:00100000:1.0:1788658252.570597:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658252.570611:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb12f125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:6513:x1875544025071872:12345-0@lo:253: 20000000:01000000:1.0:1788658252.570683:0:6531:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788658252.570686:0:6531:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788658252.571370:0:6552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788658252.571441:0:6531:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788658252.575102:0:6531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658252.583167:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788658252.583672:0:6531:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788658252.583686:0:6531:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788658252.583694:0:6531:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788658252.583697:0:6531:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788658252.583725:0:6531:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788658252.584013:0:6531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658252.584198:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788658252.584213:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788658252.584229:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788658252.584241:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788658252.584254:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788658252.584305:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788658252.584312:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788658252.584323:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788658252.584328:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788658252.584338:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788658252.584341:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788658252.584352:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788658252.584363:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788658252.584384:0:6531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788658252.584388:0:6531:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788658252.584393:0:6531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658252.584486:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788658252.584495:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788658252.584517:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788658252.584530:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788658252.584544:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788658252.584553:0:6531:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788658252.584574:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788658252.584581:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788658252.584591:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788658252.584602:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788658252.584614:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788658252.584633:0:6531:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788658252.584655:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788658252.584662:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788658252.584674:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788658252.584698:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788658252.584794:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788658252.584815:0:6531:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788658252.584823:0:6531:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788658252.594669:0:6554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788658252.595481:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788658252.595512:0:6531:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.153@tcp for mdt 20000000:01000000:1.0:1788658252.595515:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:1.0:1788658252.595532:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788658252.595538:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788658252.595551:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788658252.595556:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:1.0:1788658252.595568:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788658252.595575:0:6531:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788658252.595588:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788658252.595604:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788658252.595645:0:6531:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788658252.595648:0:6531:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788658252.595652:0:6531:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788658252.595721:0:6531:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788658252.595725:0:6531:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788658252.596641:0:6555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788658252.599180:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788658252.599242:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788658252.599259:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1788658252.599271:0:6531:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788658252.599273:0:6531:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788658252.609229:0:6556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788658252.609608:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788658252.609646:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788658252.609659:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788658252.609672:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788658252.609674:0:6531:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788658252.609679:0:6531:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788658252.609682:0:6531:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788658252.609688:0:6531:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788658252.610122:0:6531:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788658252.610467:0:6557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788658252.610576:0:6531:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788658252.640518:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788658252.640578:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788658252.640595:0:6531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788658252.640630:0:6531:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788658252.640664:0:6531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.640686:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.640698:0:6531:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.641153:0:6531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.641162:0:6531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.641237:0:6531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.641245:0:6531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000067156da1 already unused, calling callback (00000000a732b953) 00010000:00010000:0.0:1788658252.641250:0:6531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.641260:0:6531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.641300:0:6531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.641308:0:6531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.641315:0:6531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067156da1/0x48e67cc629c6e3de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788658252.641341:0:6531:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788658252.678606:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb12f125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:6513:x1875544025071872:12345-0@lo:253: Request processed in 107973us (108454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658252.678632:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658252.678882:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c545524 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025071872:0@lo:253: 10000000:01000000:3.0:1788658252.678899:0:6513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788658252.679166:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658252.679170:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658252.679171:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658252.679172:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788658252.679174:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658252.679176:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658252.679177:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658252.679179:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658252.679180:0:6513:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788658252.679181:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658252.679183:0:6513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788658252.679291:0:6513:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009c670b6f from lustre-MDT0000 10000000:01000000:0.0:1788658252.679327:0:6513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788658252.679330:0:6513:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788658252.679334:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a1eae393380 10000000:01000000:0.0:1788658252.679339:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658252.683092:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1eae393380 from 1 10000000:01000000:0.0:1788658252.683103:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788658252.683154:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.683166:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.683176:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658252.683202:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6788498 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072000:0@lo:101: 00000100:00100000:0.0:1788658252.683316:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658252.683393:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b925388d going to sleep for 11 seconds 00000100:00100000:1.0:1788658252.683572:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025072000 00000100:00100000:1.0:1788658252.683582:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025072000 00000100:00100000:1.0:1788658252.683664:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658252.683673:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2186a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:6513:x1875544025072000:12345-0@lo:101: 00010000:00010000:1.0:1788658252.683687:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658252.683733:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007f3237e3/0x48e67cc629c6e3ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e3e5 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658252.683759:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f3237e3/0x48e67cc629c6e3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e3e5 expref: 6 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658252.683769:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007f3237e3/0x48e67cc629c6e3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e3e5 expref: 6 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658252.683778:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007f3237e3, rc 0) 00000100:00100000:1.0:1788658252.683822:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2186a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:6513:x1875544025072000:12345-0@lo:101: Request processed in 151us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658252.683829:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658252.683930:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6788498 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072000:0@lo:101: 00010000:00010000:2.0:1788658252.683951:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.683961:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658252.684038:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000840d6454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072128:0@lo:501: 00000100:00100000:2.0:1788658252.684065:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658252.684095:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000008774b6e3 going to sleep for 11 seconds 00000100:00100000:1.0:1788658252.684266:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025072128 00000100:00100000:1.0:1788658252.684271:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025072128 00000100:00100000:1.0:1788658252.684303:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658252.684309:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2dcf5c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:6513:x1875544025072128:12345-0@lo:501: 00000100:00100000:1.0:1788658252.684397:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2dcf5c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:6513:x1875544025072128:12345-0@lo:501: Request processed in 88us (331us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658252.684404:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658252.684481:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000840d6454 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072128:0@lo:501: 10000000:01000000:3.0:1788658252.684508:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788658252.684527:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.684535:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658252.684543:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1ec1212800 10000000:01000000:3.0:1788658252.684549:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788658252.684553:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a1ec1212800 10000000:01000000:3.0:1788658252.684555:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788658252.684557:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a1ec1212800 from 1 10000000:01000000:3.0:1788658252.684559:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788658252.684583:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000f6da385a/0x48e67cc629c6e3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.684602:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000f6da385a/0x48e67cc629c6e3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.684609:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000f6da385a/0x48e67cc629c6e3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658252.684629:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072256:0@lo:101: 00000100:00100000:3.0:1788658252.684670:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658252.684684:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000001596c0c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788658252.684818:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025072256 00000100:00100000:2.0:1788658252.684823:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025072256 00000100:00100000:2.0:1788658252.684842:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658252.684848:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008673b13d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:6513:x1875544025072256:12345-0@lo:101: 00010000:00010000:2.0:1788658252.684856:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658252.684868:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b6c3c83/0x48e67cc629c6e3fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e3f3 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.684883:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b6c3c83/0x48e67cc629c6e3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e3f3 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.684891:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b6c3c83/0x48e67cc629c6e3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e3f3 expref: 7 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.684897:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b6c3c83, rc 0) 00000100:00100000:2.0:1788658252.684938:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008673b13d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+7:6513:x1875544025072256:12345-0@lo:101: Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658252.684943:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658252.685142:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072256:0@lo:101: 00010000:00010000:3.0:1788658252.685155:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000f6da385a/0x48e67cc629c6e3f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.685161:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000f6da385a/0x48e67cc629c6e3f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658252.685175:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788658252.685178:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000f6da385a/0x48e67cc629c6e3f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.685182:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000f6da385a/0x48e67cc629c6e3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658252.685188:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788658252.685191:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658252.685194:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a1ec1212800 10000000:01000000:3.0:1788658252.685196:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788658252.685207:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788658252.685209:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788658252.685223:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.685229:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.685235:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658252.685246:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072384:0@lo:101: 00000100:00100000:3.0:1788658252.685271:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658252.685301:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000001596c0c6 going to sleep for 11 seconds 00000100:00100000:1.0:1788658252.685371:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025072384 00000100:00100000:1.0:1788658252.685381:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025072384 00000100:00100000:1.0:1788658252.685401:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658252.685406:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e39fea8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+7:6513:x1875544025072384:12345-0@lo:101: 00010000:00010000:1.0:1788658252.685414:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658252.685423:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003426adad/0x48e67cc629c6e408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e401 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658252.685436:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003426adad/0x48e67cc629c6e408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e401 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658252.685444:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003426adad/0x48e67cc629c6e408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e401 expref: 8 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658252.685450:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003426adad, rc 0) 00000100:00100000:1.0:1788658252.685490:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e39fea8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+8:6513:x1875544025072384:12345-0@lo:101: Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658252.685496:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658252.685568:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072384:0@lo:101: 00010000:00010000:3.0:1788658252.685578:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.685583:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658252.685656:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072512:0@lo:501: 00000100:00100000:3.0:1788658252.685680:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658252.685700:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000001596c0c6 going to sleep for 11 seconds 00000100:00100000:1.0:1788658252.685830:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025072512 00000100:00100000:1.0:1788658252.685834:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025072512 00000100:00100000:1.0:1788658252.685853:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658252.685858:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000970af928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+8:6513:x1875544025072512:12345-0@lo:501: 00000100:00100000:1.0:1788658252.685980:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000970af928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:6513:x1875544025072512:12345-0@lo:501: Request processed in 121us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658252.685986:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658252.686120:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072512:0@lo:501: 00000100:00100000:3.0:1788658252.686150:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072640:0@lo:503: 00000100:00100000:3.0:1788658252.686190:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658252.686216:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000001596c0c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788658252.686286:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025072640 00000100:00100000:2.0:1788658252.686292:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025072640 00000100:00100000:2.0:1788658252.686317:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658252.686322:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000be7edcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:6513:x1875544025072640:12345-0@lo:503: 00000100:00100000:2.0:1788658252.686414:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000be7edcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:6513:x1875544025072640:12345-0@lo:503: Request processed in 91us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658252.686421:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658252.686502:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025072640:0@lo:503: 00000100:00100000:3.0:1788658252.687495:0:6558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6558:1875544025072768:0@lo:502: 00000100:00100000:3.0:1788658252.687550:0:6558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658252.687653:0:6558:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d3da2245 going to sleep for 11 seconds 00000100:00100000:2.0:1788658252.687734:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025072768 00000100:00100000:2.0:1788658252.687741:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025072768 00000100:00100000:2.0:1788658252.687825:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658252.687834:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043d31062 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:6558:x1875544025072768:12345-0@lo:502: 00000100:00100000:2.0:1788658252.687964:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043d31062 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:6558:x1875544025072768:12345-0@lo:502: Request processed in 132us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658252.687971:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658252.688047:0:6558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6558:1875544025072768:0@lo:502: 00000020:01000000:3.0:1788658252.688076:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658252.688089:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658252.688092:0:6558:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788658252.688096:0:6558:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788658252.688100:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658252.688113:0:6558:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ec3d18be) 00000020:00000080:3.0:1788658252.688132:0:6558:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788658252.688137:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788658252.688219:0:6558:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788658252.688229:0:6558:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6e416 00000020:00000080:3.0:1788658252.688483:0:6558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788658252.688487:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658252.688491:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658252.688493:0:6558:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788658252.688495:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658252.688498:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658252.688500:0:6558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788658252.688502:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658252.688515:0:6558:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000000487cd7d) 00000020:00000080:3.0:1788658252.688526:0:6558:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788658252.688531:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788658252.688533:0:6558:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788658252.688535:0:6558:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788658252.688540:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788658252.688611:0:6558:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009c670b6f from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788658252.688634:0:6558:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004cb8497f) 00000020:00000080:3.0:1788658252.688648:0:6558:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788658252.688746:0:6558:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788658252.688753:0:6558:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6e42b 00000020:00000080:3.0:1788658252.688842:0:6558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788658252.688848:0:6558:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788658252.688853:0:6558:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x48e67cc629c6e432 00080000:01000000:3.0:1788658252.688858:0:6558:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788658252.688862:0:6558:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6e439 00080000:10000000:3.0:1788658252.689409:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788658252.689540:0:6558:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788658252.701585:0:6558:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788658252.823734:0:6558:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788658252.824581:0:6558:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788658252.829438:0:6558:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788658252.829806:0:6558:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788658252.833760:0:6558:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e8d1ffb9) 00000020:00000080:3.0:1788658252.833785:0:6558:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788658252.833875:0:6558:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788658252.833885:0:6558:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6e447 00000020:00000080:0.0:1788658252.846549:0:6558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788658252.848314:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1788658252.851501:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1788658252.853893:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788658252.875345:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788658252.885143:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1788658252.898032:0:6558:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1788658252.899916:0:6558:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x48e67cc629c6e44e 00000020:00000080:0.0:1788658252.904324:0:6558:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788658252.904343:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658252.904353:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658252.904355:0:6558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788658252.904360:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658252.904366:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658252.904367:0:6558:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788658252.904370:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788658252.904372:0:6558:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788658252.904374:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658252.904377:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658252.904378:0:6558:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788658252.904381:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658252.904385:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658252.904386:0:6558:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788658252.904390:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788658252.904451:0:6558:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788658252.904516:0:6558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b230745 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6558:1875544025072896:0@lo:502: 00000100:00100000:0.0:1788658252.904639:0:6558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658252.904751:0:6558:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f92f6408 going to sleep for 11 seconds 00000100:00100000:2.0:1788658252.904829:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025072896 00000100:00100000:2.0:1788658252.904836:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025072896 00000100:00100000:2.0:1788658252.904885:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658252.904894:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088a7048b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:6558:x1875544025072896:12345-0@lo:502: 00000100:00100000:2.0:1788658252.905023:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088a7048b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:6558:x1875544025072896:12345-0@lo:502: Request processed in 130us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658252.905031:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658252.905113:0:6558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b230745 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6558:1875544025072896:0@lo:502: 00000020:01000000:3.0:1788658252.905145:0:6558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658252.905151:0:6558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658252.905153:0:6558:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788658252.905156:0:6558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788658252.905761:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788658252.905792:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788658252.905814:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.905825:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658252.905835:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ec1212800 from 1 10000000:01000000:2.0:1788658252.905847:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658252.905879:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.905887:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.905897:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658252.905914:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006ac17e9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073024:0@lo:101: 00000100:00100000:2.0:1788658252.905954:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658252.905991:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000299cdb60 going to sleep for 11 seconds 00000100:00100000:0.0:1788658252.906102:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025073024 00000100:00100000:0.0:1788658252.906108:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025073024 00000100:00100000:0.0:1788658252.906152:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788658252.906158:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000679b4aca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:6513:x1875544025073024:12345-0@lo:101: 00010000:00010000:0.0:1788658252.906169:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658252.906180:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec5047f3/0x48e67cc629c6e45c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e455 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.906200:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec5047f3/0x48e67cc629c6e45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e455 expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.906208:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec5047f3/0x48e67cc629c6e45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e455 expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.906216:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec5047f3, rc 0) 00000100:00100000:0.0:1788658252.906249:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000679b4aca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:6513:x1875544025073024:12345-0@lo:101: Request processed in 92us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658252.906255:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788658252.906289:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006ac17e9a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073024:0@lo:101: 00010000:00010000:0.0:1788658252.906300:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.906308:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658252.907034:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1cb9b1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073152:0@lo:256: 00000100:00100000:0.0:1788658252.907077:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658252.907111:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f92f6408 going to sleep for 11 seconds 00000100:00100000:2.0:1788658252.908753:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025073152 00000100:00100000:2.0:1788658252.908767:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025073152 00000100:00100000:2.0:1788658252.908823:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658252.908831:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003033c654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:6513:x1875544025073152:12345-0@lo:256: 20000000:01000000:2.0:1788658252.908852:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788658252.908858:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788658252.908962:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003033c654 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:6513:x1875544025073152:12345-0@lo:256: Request processed in 132us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658252.908970:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658252.909163:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1cb9b1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073152:0@lo:256: 10000000:01000000:0.0:1788658252.909919:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788658252.910535:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.910546:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658252.910553:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ec1212800 from 1 10000000:01000000:0.0:1788658252.910556:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658252.910592:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.910597:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.910605:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658252.910624:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1cb9b1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073280:0@lo:101: 00000100:00100000:0.0:1788658252.910693:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658252.910753:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f92f6408 going to sleep for 11 seconds 00000100:00100000:3.0:1788658252.910912:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025073280 00000100:00100000:3.0:1788658252.910919:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025073280 00000100:00100000:3.0:1788658252.910950:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658252.910957:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002db50b95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:6513:x1875544025073280:12345-0@lo:101: 00010000:00010000:3.0:1788658252.910970:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658252.910984:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de114b54/0x48e67cc629c6e46a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e463 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.911015:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de114b54/0x48e67cc629c6e46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e463 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.911025:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de114b54/0x48e67cc629c6e46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e463 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.911033:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de114b54, rc 0) 00000100:00100000:3.0:1788658252.911069:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002db50b95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:6513:x1875544025073280:12345-0@lo:101: Request processed in 112us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658252.911075:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658252.911922:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1cb9b1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073280:0@lo:101: 00010000:00010000:0.0:1788658252.911938:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.911946:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658252.912012:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1cb9b1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073408:0@lo:501: 00000100:00100000:0.0:1788658252.912047:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658252.912120:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f92f6408 going to sleep for 11 seconds 00000100:00100000:3.0:1788658252.914873:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025073408 00000100:00100000:3.0:1788658252.914887:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025073408 00000100:00100000:0.0:1788658252.917380:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658252.917393:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048867e2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:6513:x1875544025073408:12345-0@lo:501: 00000100:00100000:0.0:1788658252.917627:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048867e2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:6513:x1875544025073408:12345-0@lo:501: Request processed in 236us (5580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658252.917644:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658252.918033:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1cb9b1b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073408:0@lo:501: 00000100:00100000:1.0:1788658252.918107:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073536:0@lo:503: 00000100:00100000:1.0:1788658252.918161:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658252.918209:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041148f5f going to sleep for 11 seconds 00000100:00100000:0.0:1788658252.918286:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025073536 00000100:00100000:0.0:1788658252.918293:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025073536 00000100:00100000:0.0:1788658252.918330:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788658252.918336:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022e39330 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:6513:x1875544025073536:12345-0@lo:503: 00000040:00080000:0.0:1788658252.918372:0:6531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658252.918421:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022e39330 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:6513:x1875544025073536:12345-0@lo:503: Request processed in 85us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658252.918427:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658252.918543:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073536:0@lo:503: 00000040:00080000:1.0:1788658252.919918:0:6562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788658252.920079:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788658252.920105:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658252.920127:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.920138:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658252.920184:0:6513:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788658252.920186:0:6513:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1ec1212800 10000000:01000000:0.0:1788658252.920189:0:6513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1ec1212800 10000000:01000000:0.0:1788658252.920192:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658252.920197:0:6513:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ec1212800 from 1 10000000:01000000:0.0:1788658252.920200:0:6513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658252.920229:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.920245:0:6513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.920254:0:6513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658252.920272:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094e0e310 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073664:0@lo:101: 00000100:00100000:0.0:1788658252.920320:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658252.920360:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ec2d4e2 going to sleep for 11 seconds 00000100:00100000:3.0:1788658252.920464:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025073664 00000100:00100000:3.0:1788658252.920471:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025073664 00000100:00100000:3.0:1788658252.920514:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658252.920522:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cbb504c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:6513:x1875544025073664:12345-0@lo:101: 00010000:00010000:3.0:1788658252.920538:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658252.920549:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6ad158d/0x48e67cc629c6e478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e471 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.920570:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6ad158d/0x48e67cc629c6e478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e471 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.920580:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6ad158d/0x48e67cc629c6e478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e471 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.920605:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6ad158d, rc 0) 00000100:00100000:3.0:1788658252.920656:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cbb504c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6513:x1875544025073664:12345-0@lo:101: Request processed in 135us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658252.920668:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658252.921861:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094e0e310 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073664:0@lo:101: 00010000:00010000:1.0:1788658252.921884:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658252.921895:0:6513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658252.921970:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073792:0@lo:501: 00000100:00100000:1.0:1788658252.922015:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658252.922151:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041148f5f going to sleep for 11 seconds 00000100:00100000:2.0:1788658252.924954:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025073792 00000100:00100000:2.0:1788658252.924973:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025073792 00000100:00100000:3.0:1788658252.925170:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658252.925179:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb0fea3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6513:x1875544025073792:12345-0@lo:501: 00000100:00100000:3.0:1788658252.925373:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb0fea3d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6513:x1875544025073792:12345-0@lo:501: Request processed in 196us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658252.925381:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658252.925471:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073792:0@lo:501: 00000100:00100000:1.0:1788658252.925522:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073920:0@lo:503: 00000100:00100000:1.0:1788658252.925585:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658252.925648:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041148f5f going to sleep for 11 seconds 00000100:00100000:3.0:1788658252.925942:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025073920 00000100:00100000:3.0:1788658252.925948:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025073920 00000100:00100000:3.0:1788658252.925971:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658252.925977:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d7a2c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6513:x1875544025073920:12345-0@lo:503: 00000100:00100000:3.0:1788658252.926058:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d7a2c5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6513:x1875544025073920:12345-0@lo:503: Request processed in 81us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658252.926066:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658252.926218:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025073920:0@lo:503: 00000100:00100000:1.0:1788658252.926759:0:6563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6563:1875544025074048:0@lo:502: 00000100:00100000:1.0:1788658252.926802:0:6563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658252.926826:0:6563:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a65cf458 going to sleep for 11 seconds 00000100:00100000:3.0:1788658252.926895:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025074048 00000100:00100000:3.0:1788658252.926900:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025074048 00000100:00100000:3.0:1788658252.926926:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658252.926933:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1df7999 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6563:x1875544025074048:12345-0@lo:502: 00000100:00100000:3.0:1788658252.927027:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1df7999 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6563:x1875544025074048:12345-0@lo:502: Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658252.927035:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658252.927145:0:6563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6563:1875544025074048:0@lo:502: 00000020:01000004:1.0:1788658252.927200:0:6563:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788658252.927222:0:6563:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003e8d02af) 00000020:00000080:1.0:1788658252.927244:0:6563:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788658252.927330:0:6563:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009c670b6f from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788658252.927334:0:6563:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009c670b6f from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788658252.927336:0:6563:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009c670b6f 4 00010000:00080000:1.0:1788658252.927366:0:6563:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003ff7b5b5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1788658252.930987:0:6563:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788658252.931211:0:6563:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788658252.931257:0:6563:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788658252.931271:0:6563:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x48e67cc629c6e486 00000100:00080000:1.0:1788658252.931281:0:6563:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658252.931286:0:6563:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003ff7b5b5 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658252.931325:0:6563:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e0232182 x1875544025074176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658252.931350:0:6563:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788658252.933282:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025074176:0@lo:38: 00000100:00100000:0.0:1788658252.933363:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658252.934901:0:6563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6563:1875544025074304:0@lo:502: 00000100:00100000:2.0:1788658252.934954:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025074176 00000100:00100000:2.0:1788658252.934962:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025074176 00000100:00100000:3.0:1788658252.934990:0:6563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658252.935018:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025074304 00000100:00100000:3.0:1788658252.935021:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025074304 00000100:00100000:3.0:1788658252.935057:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788658252.935065:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5546d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6563:x1875544025074304:12345-0@lo:502: 00000100:00100000:3.0:1788658252.935190:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5546d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6563:x1875544025074304:12345-0@lo:502: Request processed in 124us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658252.935198:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788658252.935244:0:6563:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017dbf012 going to sleep for 11 seconds 00000100:00100000:3.0:1788658252.935264:0:6563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6563:1875544025074304:0@lo:502: 00000040:00080000:3.0:1788658252.935289:0:6563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788658252.935346:0:6513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788658252.935372:0:6513:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788658252.935387:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.935398:0:6513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788658252.935443:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788658252.935445:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658252.935446:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658252.935448:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658252.935449:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658252.935450:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658252.935452:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658252.935453:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658252.935454:0:6513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788658252.935455:0:6513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788658252.935457:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658252.935458:0:6513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788658252.935463:0:6513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788658252.935465:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788658252.935467:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658252.935468:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658252.935469:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658252.935470:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658252.935471:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658252.935475:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658252.935476:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658252.935477:0:6513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788658252.935478:0:6513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788658252.935479:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658252.935480:0:6513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788658252.935492:0:6513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788658252.935499:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025074432:0@lo:253: 00000100:00100000:3.0:1788658252.935529:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658252.935543:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017dbf012 going to sleep for 11 seconds 00000100:00100000:2.0:1788658252.936336:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658252.936344:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031555c2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875544025074176:12345-0@lo:38: 00000100:00100000:2.0:1788658252.936410:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031555c2f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875544025074176:12345-0@lo:38: Request processed in 66us (3048us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788658252.936427:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658252.939803:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025074432 00000100:00100000:1.0:1788658252.939820:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025074432 00000100:00100000:1.0:1788658252.939897:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658252.939906:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000621dbe34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6513:x1875544025074432:12345-0@lo:253: 20000000:01000000:1.0:1788658252.939939:0:6531:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788658252.939954:0:6531:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788658252.941172:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788658252.941185:0:3646:0:(import.c:65:import_set_state_nolock()) 000000003ff7b5b5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658252.941192:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788658252.941196:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025074176:0@lo:38: 20000000:01000000:1.0:1788658252.963124:0:6531:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788658252.963147:0:6531:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788658252.963351:0:6552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788658252.963356:0:6552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788658252.963377:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.963395:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ec5047f3/0x48e67cc629c6e45c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e455 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.963403:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.963442:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ec5047f3/0x48e67cc629c6e45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e455 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.963455:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ec5047f3/0x48e67cc629c6e45c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e455 expref: 12 pid: 6530 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658252.963470:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a29c4ef2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025074560:0@lo:104: 00000100:00100000:3.0:1788658252.963547:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658252.963603:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7e3586d going to sleep for 11 seconds 00000100:00100000:0.0:1788658252.963689:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025074560 00000100:00100000:0.0:1788658252.963696:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025074560 00000100:00100000:0.0:1788658252.963781:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658252.963787:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5dbab78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6552:x1875544025074560:12345-0@lo:104: 00010000:00010000:0.0:1788658252.963798:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658252.963859:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658252.963863:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5dbab78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6552:x1875544025074560:12345-0@lo:104: Request processed in 77us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658252.963870:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658252.964075:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a29c4ef2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025074560:0@lo:104: 00010000:00010000:1.0:1788658252.964093:0:6552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964160:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658252.964166:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964173:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b77c973d already unused, calling callback (00000000affb3be2) 10000000:00010000:2.0:1788658252.964176:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964187:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658252.964196:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658252.964201:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788658252.964238:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964245:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658252.964258:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964267:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e45c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964286:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658252.964288:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658252.964290:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658252.964447:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b610f710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025074688:0@lo:103: 00000100:00100000:1.0:1788658252.964478:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658252.964589:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025074688 00000100:00100000:2.0:1788658252.964598:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025074688 00010000:00010000:2.0:1788658252.964617:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ec5047f3/0x48e67cc629c6e45c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e455 expref: 13 pid: 6530 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658252.964657:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658252.964663:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e14dcd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:3648:x1875544025074688:12345-0@lo:103: 00010000:00010000:2.0:1788658252.964674:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658252.964678:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ec5047f3/0x48e67cc629c6e45c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e455 expref: 13 pid: 6530 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964687:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ec5047f3/0x48e67cc629c6e45c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e455 expref: 13 pid: 6530 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964700:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ec5047f3/0x48e67cc629c6e45c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e455 expref: 13 pid: 6530 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964744:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964751:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788658252.964763:0:6521:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001407992s 00010000:00010000:2.0:1788658252.964767:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964772:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964779:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964793:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964798:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fc774559 already unused, calling callback (00000000a732b953) 00010000:00010000:2.0:1788658252.964801:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964808:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964823:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658252.964832:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658252.964869:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e14dcd7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:3648:x1875544025074688:12345-0@lo:103: Request processed in 207us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658252.964876:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788658252.964940:0:6552:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.964957:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658252.964963:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc774559/0x48e67cc629c6e48d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658252.965141:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000621dbe34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:6513:x1875544025074432:12345-0@lo:253: Request processed in 25236us (29611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658252.965149:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658252.965242:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b610f710 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025074688:0@lo:103: 00000100:00100000:3.0:1788658252.965322:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6513:1875544025074432:0@lo:253: 10000000:01000000:3.0:1788658252.965332:0:6513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788658252.965335:0:6513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658252.965337:0:6513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658252.965338:0:6513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658252.965339:0:6513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658252.965340:0:6513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658252.965341:0:6513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658252.965342:0:6513:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658252.965344:0:6513:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658252.965345:0:6513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788658252.965346:0:6513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788658252.965347:0:6513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658252.965349:0:6513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788658252.965358:0:6513:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788658252.973559:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788658252.973785:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788658252.974047:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788658252.974213:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788658252.974401:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788658252.974546:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788658252.976163:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788658252.976330:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788658252.976509:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788658252.976686:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788658252.976949:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788658252.977119:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788658252.993086:0:6513:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788658253.019763:0:6513:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788658253.019859:0:6568:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788658253.019864:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788658253.020344:0:6569:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788658253.021622:0:6513:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788658253.021896:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788658253.022349:0:6513:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788658253.022357:0:6513:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788658253.022468:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658253.023523:0:6513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788658253.028190:0:6513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788658253.028291:0:6513:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788658253.028534:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788658253.029036:0:6513:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788658253.031286:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788658253.031436:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788658253.031591:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788658253.032588:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000040:00080000:3.0:1788658253.032698:0:6569:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1788658253.033043:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788658253.034961:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788658253.035136:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788658253.035313:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788658253.035440:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788658253.035569:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788658253.035760:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788658253.035897:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788658253.036017:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788658253.036142:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788658253.036282:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788658253.036402:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788658253.036743:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000040:00080000:3.0:1788658253.036774:0:6569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788658253.036854:0:6569:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788658253.036859:0:6569:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1788658253.036925:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788658253.037056:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788658253.037184:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788658253.037302:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788658253.037434:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788658253.038328:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788658253.038467:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788658253.038611:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788658253.039064:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788658253.039239:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788658253.039358:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788658253.039500:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788658253.039656:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788658253.039896:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788658253.040103:0:6513:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788658253.040303:0:6513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788658253.043254:0:6513:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788658253.043301:0:6513:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa33e41c37988 00100000:10000000:1.0:1788658253.043310:0:6513:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788658253.044271:0:6513:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788658253.044288:0:6513:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788658253.044304:0:6513:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788658253.044321:0:6513:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788658253.045143:0:6513:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658253.045318:0:6513:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788658253.246869:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658254.271081:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658255.297844:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658256.319923:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658257.099646:0:6813:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788658257.354156:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788658258.035613:0:6865:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658258.036125:0:6865:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1788658258.367865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788658258.367879:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788658258.367882:0:37:0:(import.c:65:import_set_state_nolock()) 000000003ff7b5b5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658258.367898:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003ff7b5b5 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658258.367927:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001951b1d4 x1875544025074944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658258.368010:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025074944:0@lo:38: 00000100:00100000:3.0:1788658258.368099:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658258.368183:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658258.368342:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025074816:0@lo:400: 00000100:00100000:2.0:1788658258.368385:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658258.368480:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025074816 00000100:00100000:3.0:1788658258.368489:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025074816 00000100:00100000:3.0:1788658258.368552:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658258.368562:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c03d903 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:3649:x1875544025074816:12345-0@lo:400: 00000100:00100000:3.0:1788658258.368624:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c03d903 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:3649:x1875544025074816:12345-0@lo:400: Request processed in 63us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658258.368632:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658258.368690:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025074816:0@lo:400: 00000100:00100000:0.0:1788658258.369032:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025074944 00000100:00100000:0.0:1788658258.369039:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025074944 00000100:00100000:0.0:1788658258.369066:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658258.369071:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004ac0e3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025074944:12345-0@lo:38: 00010000:00080000:0.0:1788658258.369099:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:0.0:1788658258.369146:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x48e67cc629c6e494 00000004:00100000:0.0:1788658258.369208:0:6538:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788658258.369361:0:6538:0:(import.c:65:import_set_state_nolock()) 00000000c47037c5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658258.370982:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004ac0e3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875544025074944:12345-0@lo:38: Request processed in 1899us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658258.371000:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788658258.374914:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001951b1d4 x1875544025074944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658258.374951:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788658258.374984:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788658258.374991:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788658258.374995:0:3646:0:(import.c:65:import_set_state_nolock()) 000000003ff7b5b5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788658258.375003:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025074944:0@lo:38: 00010000:00010000:1.0:1788658259.391031:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788658259.903102:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788658259.903114:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ec1212800 from 3 10000000:01000000:1.0:1788658259.903120:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788658259.903207:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658259.903224:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658259.903238:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658259.903274:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008405db62 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025075072:0@lo:101: 00000100:00100000:1.0:1788658259.903380:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658259.903475:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8b0b20d going to sleep for 11 seconds 00000100:00100000:0.0:1788658259.903672:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025075072 00000100:00100000:0.0:1788658259.903683:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025075072 00000100:00100000:0.0:1788658259.903774:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658259.903784:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cbe942f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:6534:x1875544025075072:12345-0@lo:101: 00010000:00010000:0.0:1788658259.903800:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658259.903818:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe1867ca/0x48e67cc629c6e4a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e49b expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658259.903848:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe1867ca/0x48e67cc629c6e4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e49b expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658259.903872:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe1867ca/0x48e67cc629c6e4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e49b expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658259.903910:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe1867ca, rc 0) 00000100:00100000:0.0:1788658259.903968:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cbe942f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6534:x1875544025075072:12345-0@lo:101: Request processed in 185us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658259.903975:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788658259.904696:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008405db62 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025075072:0@lo:101: 00010000:00010000:1.0:1788658259.904747:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658259.904758:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658259.904837:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008405db62 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025075200:0@lo:256: 00000100:00100000:1.0:1788658259.904918:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658259.904973:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f8b0b20d going to sleep for 11 seconds 00000100:00100000:3.0:1788658259.905122:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025075200 00000100:00100000:3.0:1788658259.905131:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025075200 00000100:00100000:3.0:1788658259.905192:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658259.905201:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6dc25c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6534:x1875544025075200:12345-0@lo:256: 20000000:01000000:3.0:1788658259.905225:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788658259.905247:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788658259.905250:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788658259.905346:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6dc25c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:6534:x1875544025075200:12345-0@lo:256: Request processed in 146us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658259.905354:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788658259.905822:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008405db62 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025075200:0@lo:256: 10000000:01000000:1.0:1788658259.905959:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658259.905968:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658259.905986:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658260.422309:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788658261.212275:0:6967:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658261.212531:0:6967:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788658261.442221:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658262.463909:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658263.490150:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658263.490187:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025075328:0@lo:400: 00000100:00100000:3.0:1788658263.490293:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658263.490375:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025075456:0@lo:400: 00000100:00100000:3.0:1788658263.490404:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658263.490452:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025075328 00000100:00100000:3.0:1788658263.490461:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025075328 00000100:00100000:3.0:1788658263.490515:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658263.490525:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b44ec036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:3649:x1875544025075328:12345-0@lo:400: 00000100:00100000:3.0:1788658263.490581:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b44ec036 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:3649:x1875544025075328:12345-0@lo:400: Request processed in 57us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658263.490609:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658263.490665:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025075328:0@lo:400: 00010000:00010000:1.0:1788658263.490969:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658263.491144:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025075456 00000100:00100000:2.0:1788658263.491150:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025075456 00000100:00100000:2.0:1788658263.491234:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658263.491241:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f59121e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025075456:12345-0@lo:400: 00000100:00100000:2.0:1788658263.491298:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f59121e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025075456:12345-0@lo:400: Request processed in 58us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658263.491305:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788658263.491978:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001f77814a x1875544025075456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658263.491994:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025075456:0@lo:400: 00010000:00010000:0.0:1788658264.512213:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658265.536583:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658266.564835:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658267.583307:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658268.606994:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069df3d24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025075712:0@lo:400: 00000100:00100000:3.0:1788658268.607062:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658268.607142:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025075712 00000100:00100000:3.0:1788658268.607149:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025075712 00000100:00100000:3.0:1788658268.607186:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658268.607192:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093cf1844 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025075712:12345-0@lo:400: 00000100:00100000:3.0:1788658268.607230:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093cf1844 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025075712:12345-0@lo:400: Request processed in 39us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658268.607246:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788658268.607285:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000069df3d24 x1875544025075712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658268.607299:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069df3d24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025075712:0@lo:400: 00010000:00010000:0.0:1788658268.607359:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658268.607421:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025075584:0@lo:400: 00000100:00100000:1.0:1788658268.607462:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658268.607521:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025075584 00000100:00100000:0.0:1788658268.607525:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025075584 00000100:00100000:0.0:1788658268.607557:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658268.607561:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1671856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:3648:x1875544025075584:12345-0@lo:400: 00000100:00100000:0.0:1788658268.607593:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1671856 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:3648:x1875544025075584:12345-0@lo:400: Request processed in 32us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658268.607597:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788658268.607651:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025075584:0@lo:400: 00010000:00010000:2.0:1788658269.642869:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658270.655087:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658271.678855:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788658271.926093:0:7465:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788658271.926098:0:7465:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788658271.926100:0:7465:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788658271.926217:0:7465:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b6127ae0 00000020:01000004:0.0:1788658271.926234:0:7465:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1788658271.926247:0:7465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788658271.926284:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000e7e65e3d) 00000020:00000080:0.0:1788658271.926302:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788658271.996453:0:7465:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788658271.996520:0:7465:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1788658272.022559:0:7465:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788658272.022829:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788658272.022840:0:7465:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788658272.022852:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6e4b0 00000020:01000004:0.0:1788658272.022859:0:7465:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788658272.022885:0:7465:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788658272.022888:0:7465:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788658272.022893:0:7465:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788658272.022916:0:7465:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788658272.022919:0:7465:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788658272.063921:0:7465:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788658272.063998:0:7465:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.153@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788658272.064003:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788658272.064006:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788658272.064007:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658272.064009:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658272.064014:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658272.064015:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658272.064017:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658272.064018:0:7465:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658272.064020:0:7465:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658272.064021:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658272.064023:0:7465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658272.064027:0:7465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788658272.064034:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658272.064035:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788658272.064036:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658272.064037:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658272.064038:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658272.064039:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658272.064040:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658272.064041:0:7465:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658272.064042:0:7465:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658272.064043:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658272.064044:0:7465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658272.064110:0:7465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788658272.064522:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025075840:0@lo:253: 00000100:00100000:2.0:1788658272.064659:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658272.064771:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025075840 00000100:00100000:0.0:1788658272.064787:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025075840 00000100:00100000:2.0:1788658272.064794:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c5bf7e11 going to sleep for 11 seconds 00000100:00100000:0.0:1788658272.064855:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658272.064865:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000326caa99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025075840:12345-0@lo:253: 20000000:01000000:0.0:1788658272.064904:0:6529:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788658272.064908:0:6529:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:0.0:1788658272.064913:0:6529:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:0.0:1788658272.064916:0:6529:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:0.0:1788658272.064961:0:6529:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:0.0:1788658272.065237:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658272.065441:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788658272.065463:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788658272.065481:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788658272.065498:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788658272.065511:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788658272.065569:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:0.0:1788658272.065578:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:0.0:1788658272.065590:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:0.0:1788658272.065596:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:0.0:1788658272.065608:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:0.0:1788658272.065613:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:0.0:1788658272.065628:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788658272.065643:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788658272.065775:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:0.0:1788658272.065786:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:0.0:1788658272.065800:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:0.0:1788658272.065813:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788658272.065829:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:0.0:1788658272.065838:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:0.0:1788658272.065854:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:0.0:1788658272.065860:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788658272.065874:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788658272.065891:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788658272.065902:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788658272.065974:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788658272.065983:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788658272.066000:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788658272.066012:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788658272.066025:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788658272.066030:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788658272.066039:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788658272.066054:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788658272.066059:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788658272.066073:0:6529:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788658272.066080:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:0.0:1788658272.069787:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788658272.070450:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788658272.070494:0:6529:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.153@tcp for mdt 20000000:01000000:2.0:1788658272.070497:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:2.0:1788658272.070517:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788658272.070525:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788658272.070540:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788658272.070545:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:2.0:1788658272.070562:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788658272.070573:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788658272.070586:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788658272.070602:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788658272.070670:0:6529:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788658272.070681:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788658272.073176:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788658272.073870:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788658272.073902:0:6529:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.153@tcp for mdt 20000000:01000000:2.0:1788658272.073905:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:2.0:1788658272.073920:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788658272.073927:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788658272.073939:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788658272.073944:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:2.0:1788658272.073955:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788658272.073962:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788658272.073974:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788658272.073988:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788658272.074012:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788658272.074015:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788658272.074018:0:6529:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788658272.074081:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788658272.074083:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788658272.074747:0:7473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788658272.074777:0:7473:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788658272.074794:0:7473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788658272.075471:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788658272.075493:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788658272.075509:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788658272.075518:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788658272.075520:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788658272.077115:0:7474:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788658272.077155:0:7474:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788658272.077171:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788658272.083733:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788658272.083819:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788658272.083855:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788658272.083873:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788658272.083888:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788658272.085216:0:7475:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788658272.085241:0:7475:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788658272.085249:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788658272.085425:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788658272.085446:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788658272.085460:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788658272.085475:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788658272.085477:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788658272.085482:0:6529:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788658272.085488:0:6529:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788658272.087108:0:7476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1788658272.087356:0:6529:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788658272.097511:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788658272.097538:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.097677:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007f3237e3/0x48e67cc629c6e3ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e3e5 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.097684:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003426adad/0x48e67cc629c6e408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e401 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.097864:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d6ad158d/0x48e67cc629c6e478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e471 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.097871:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.097914:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d6ad158d/0x48e67cc629c6e478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e471 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.097927:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d6ad158d/0x48e67cc629c6e478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e471 expref: 12 pid: 6530 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658272.097939:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069df3d24 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025075968:0@lo:104: 00000100:00100000:3.0:1788658272.098000:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658272.098100:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003426adad/0x48e67cc629c6e408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e401 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.098107:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003426adad/0x48e67cc629c6e408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e401 expref: 12 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658272.098114:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4c44237 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025076096:0@lo:104: 00000100:00100000:3.0:1788658272.098134:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658272.098214:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007f3237e3/0x48e67cc629c6e3ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e3e5 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.098221:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007f3237e3/0x48e67cc629c6e3ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e3e5 expref: 12 pid: 6529 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658272.098228:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069b0ef7d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025076224:0@lo:104: 00000100:00100000:3.0:1788658272.098256:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658272.098453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025075968 00000100:00100000:0.0:1788658272.098461:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025075968 00000100:00100000:0.0:1788658272.098501:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025076096 00000100:00100000:0.0:1788658272.098503:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025076096 00000100:00100000:0.0:1788658272.098517:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658272.098524:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2d0f3ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6529:x1875544025075968:12345-0@lo:104: 00010000:00010000:0.0:1788658272.098536:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098605:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658272.098610:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2d0f3ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6529:x1875544025075968:12345-0@lo:104: Request processed in 86us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.098617:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658272.098636:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658272.098642:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4f0eef4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6529:x1875544025076096:12345-0@lo:104: 00010000:00010000:0.0:1788658272.098648:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098693:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788658272.098697:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4f0eef4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6529:x1875544025076096:12345-0@lo:104: Request processed in 57us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.098725:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788658272.098743:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658272.098748:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098765:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f8efaea7 already unused, calling callback (00000000affb3be2) 10000000:00010000:0.0:1788658272.098768:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098775:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658272.098781:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658272.098786:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658272.098815:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098821:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658272.098839:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098846:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000f8efaea7/0x48e67cc629c6e471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e478 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098858:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658272.098860:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098864:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b8ded7b4 already unused, calling callback (00000000affb3be2) 10000000:00010000:0.0:1788658272.098865:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098880:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658272.098885:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658272.098890:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658272.098900:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098904:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658272.098916:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098921:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000b8ded7b4/0x48e67cc629c6e401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e408 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.098930:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658272.098931:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658272.098932:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658272.098944:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038ad9ab1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025076352:0@lo:103: 00000100:00100000:0.0:1788658272.098970:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658272.099011:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000035b784d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025076480:0@lo:103: 00000100:00100000:0.0:1788658272.099032:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658272.099058:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025076352 00000100:00100000:0.0:1788658272.099062:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025076352 00010000:00010000:0.0:1788658272.099077:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d6ad158d/0x48e67cc629c6e478 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e471 expref: 13 pid: 6530 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658272.099104:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025076480 00000100:00100000:0.0:1788658272.099107:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025076480 00010000:00010000:0.0:1788658272.099116:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003426adad/0x48e67cc629c6e408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e401 expref: 14 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658272.099126:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658272.099132:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ab9bf37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:3650:x1875544025076352:12345-0@lo:103: 00010000:00010000:0.0:1788658272.099140:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658272.099144:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d6ad158d/0x48e67cc629c6e478 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e471 expref: 14 pid: 6530 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.099151:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d6ad158d/0x48e67cc629c6e478 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e471 expref: 14 pid: 6530 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.099165:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658272.099189:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ab9bf37 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:3650:x1875544025076352:12345-0@lo:103: Request processed in 59us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.099195:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658272.099205:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658272.099210:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000401cfb57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:3647:x1875544025076480:12345-0@lo:103: 00010000:00010000:0.0:1788658272.099217:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658272.099220:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003426adad/0x48e67cc629c6e408 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e401 expref: 13 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.099226:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003426adad/0x48e67cc629c6e408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e401 expref: 13 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.099234:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658272.099262:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000401cfb57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:3647:x1875544025076480:12345-0@lo:103: Request processed in 52us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.099267:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658272.099397:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000035b784d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025076480:0@lo:103: 00000100:00100000:0.0:1788658272.099420:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038ad9ab1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025076352:0@lo:103: 00010000:00010000:2.0:1788658272.099494:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658272.101454:0:6529:0:(client.c:2716:ptlrpc_set_wait()) set 000000001788896c going to sleep for 11 seconds 00010000:00010000:3.0:1788658272.101490:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d6ad158d/0x48e67cc629c6e478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e471 expref: 12 pid: 6530 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658272.101506:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069df3d24 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025075968:0@lo:104: 00010000:00010000:3.0:1788658272.101516:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003426adad/0x48e67cc629c6e408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e401 expref: 11 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658272.101526:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4c44237 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025076096:0@lo:104: 00000100:00100000:0.0:1788658272.101646:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025076224 00000100:00100000:0.0:1788658272.101664:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025076224 00000100:00100000:0.0:1788658272.101743:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658272.101753:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024a1dd09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6529:x1875544025076224:12345-0@lo:104: 00010000:00010000:0.0:1788658272.101767:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.101832:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658272.101836:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024a1dd09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6529:x1875544025076224:12345-0@lo:104: Request processed in 87us (3581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.101843:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788658272.101863:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658272.101868:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.101875:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000067156da1 already unused, calling callback (00000000affb3be2) 10000000:00010000:0.0:1788658272.101878:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.101885:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658272.101891:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658272.101911:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658272.101942:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.101949:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658272.101963:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.101969:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 0000000067156da1/0x48e67cc629c6e3e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e3ec expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.101984:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658272.101985:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658272.101987:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658272.101998:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000038ad9ab1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025076608:0@lo:103: 00000100:00100000:0.0:1788658272.102032:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658272.102074:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025076608 00000100:00100000:0.0:1788658272.102078:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025076608 00010000:00010000:0.0:1788658272.102093:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007f3237e3/0x48e67cc629c6e3ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e3e5 expref: 11 pid: 6529 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658272.102114:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658272.102120:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035b784d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:3648:x1875544025076608:12345-0@lo:103: 00010000:00010000:0.0:1788658272.102129:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658272.102134:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007f3237e3/0x48e67cc629c6e3ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e3e5 expref: 11 pid: 6529 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102144:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007f3237e3/0x48e67cc629c6e3ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e3e5 expref: 11 pid: 6529 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102168:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102175:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102188:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102194:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102200:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102206:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102211:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ecad1909 already unused, calling callback (00000000a732b953) 00010000:00010000:0.0:1788658272.102214:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102221:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102229:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.102240:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658272.102267:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035b784d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:3648:x1875544025076608:12345-0@lo:103: Request processed in 147us (234us total) trans 0 rc 0/0 00010000:00010000:3.0:1788658272.102477:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007f3237e3/0x48e67cc629c6e3ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e3e5 expref: 11 pid: 6529 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658272.102488:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069b0ef7d pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025076224:0@lo:104: 00010000:00010000:3.0:1788658272.102510:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.102519:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.102524:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.102530:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788658272.102559:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788658272.102782:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000038ad9ab1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025076608:0@lo:103: 00000100:00100000:0.0:1788658272.103128:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658272.106514:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000326caa99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:7465:x1875544025075840:12345-0@lo:253: Request processed in 41642us (41852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658272.106539:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788658272.110463:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025075840:0@lo:253: 10000000:01000000:2.0:1788658272.110484:0:7465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788658272.110488:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658272.110490:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788658272.110492:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658272.110493:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1788658272.110494:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658272.110495:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658272.110496:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658272.110498:0:7465:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788658272.110499:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658272.110500:0:7465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788658272.110522:0:7465:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b6127ae0 from lustre-MDT0001 10000000:01000000:2.0:1788658272.110562:0:7465:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788658272.110565:0:7465:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788658272.110583:0:7465:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1eae393380 local copy 10000000:01000000:2.0:1788658272.110587:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788658272.110622:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.110633:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.110641:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658272.110671:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025076736:0@lo:101: 00000100:00100000:2.0:1788658272.110752:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.110787:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000058899d82 going to sleep for 11 seconds 00000100:00100000:3.0:1788658272.111019:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025076736 00000100:00100000:3.0:1788658272.111026:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025076736 00000100:00100000:3.0:1788658272.111064:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658272.111073:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f97352e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:7465:x1875544025076736:12345-0@lo:101: 00010000:00010000:3.0:1788658272.111087:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658272.111100:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc774559/0x48e67cc629c6e4c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e4be expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.111123:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc774559/0x48e67cc629c6e4c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e4be expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.111133:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc774559/0x48e67cc629c6e4c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e4be expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.111141:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc774559, rc 0) 00000100:00100000:3.0:1788658272.111187:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f97352e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:7465:x1875544025076736:12345-0@lo:101: Request processed in 115us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658272.111193:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658272.111477:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025076736:0@lo:101: 00010000:00010000:2.0:1788658272.111490:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.111498:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658272.111592:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025076864:0@lo:501: 00000100:00100000:2.0:1788658272.111618:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.111648:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000058899d82 going to sleep for 11 seconds 00000100:00100000:3.0:1788658272.111827:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025076864 00000100:00100000:3.0:1788658272.111831:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025076864 00000100:00100000:3.0:1788658272.111914:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658272.111921:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfa50a8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:7465:x1875544025076864:12345-0@lo:501: 00000100:00100000:3.0:1788658272.111991:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfa50a8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:7465:x1875544025076864:12345-0@lo:501: Request processed in 70us (372us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788658272.111998:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788658272.112052:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025076864:0@lo:501: 10000000:01000000:2.0:1788658272.112066:0:7465:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788658272.112081:0:7465:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788658272.112085:0:7465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112103:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112110:0:7465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112127:0:7465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788658272.112150:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1ec11f4800 10000000:01000000:2.0:1788658272.112154:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788658272.112158:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a1eae393380 10000000:01000000:2.0:1788658272.112160:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788658272.112163:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a1eae393380 from 1 10000000:01000000:2.0:1788658272.112165:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788658272.112179:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 000000009d41cbe9/0x48e67cc629c6e4cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112186:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 000000009d41cbe9/0x48e67cc629c6e4cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112192:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 000000009d41cbe9/0x48e67cc629c6e4cc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658272.112202:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025076992:0@lo:101: 00000100:00100000:2.0:1788658272.112224:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.112424:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbfa5c2b going to sleep for 11 seconds 00010000:00010000:2.0:1788658272.112437:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658272.112441:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112458:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000237738c6 already unused, calling callback (00000000affb3be2) 10000000:00010000:2.0:1788658272.112461:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112467:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658272.112474:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658272.112479:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788658272.112493:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112499:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658272.112511:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112517:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e4be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x48e67cc629c6e4c5 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112532:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658272.112533:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658272.112535:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658272.112580:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee9ea2ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025077120:0@lo:103: 00000100:00100000:0.0:1788658272.112610:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.112692:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025077120 00000100:00100000:2.0:1788658272.112697:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025077120 00000100:00100000:2.0:1788658272.112768:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658272.112774:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c5b4b43 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:3649:x1875544025077120:12345-0@lo:103: 00010000:00010000:2.0:1788658272.112783:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658272.112799:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc774559/0x48e67cc629c6e4c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e4be expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.112810:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658272.112835:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c5b4b43 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:3649:x1875544025077120:12345-0@lo:103: Request processed in 61us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658272.112840:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658272.112988:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025076992 00000100:00100000:1.0:1788658272.112992:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025076992 00000100:00100000:1.0:1788658272.113014:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788658272.113020:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034f5c2e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:7465:x1875544025076992:12345-0@lo:101: 00010000:00010000:1.0:1788658272.113028:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658272.113039:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf7eacaf/0x48e67cc629c6e4d3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e4cc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.113053:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf7eacaf/0x48e67cc629c6e4d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e4cc expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.113061:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf7eacaf/0x48e67cc629c6e4d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e4cc expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.113073:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf7eacaf, rc 0) 00000100:00100000:1.0:1788658272.113222:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034f5c2e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:7465:x1875544025076992:12345-0@lo:101: Request processed in 202us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.113229:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658272.113334:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee9ea2ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025077120:0@lo:103: 00000100:00100000:2.0:1788658272.113476:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025076992:0@lo:101: 00010000:00010000:2.0:1788658272.113486:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 000000009d41cbe9/0x48e67cc629c6e4cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4d3 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.113494:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 000000009d41cbe9/0x48e67cc629c6e4cc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e4d3 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658272.113508:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788658272.113521:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 000000009d41cbe9/0x48e67cc629c6e4cc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4d3 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.113528:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 000000009d41cbe9/0x48e67cc629c6e4cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4d3 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658272.113535:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a1ec11f4800 10000000:01000000:2.0:1788658272.113540:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788658272.113544:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a1ec11f4800 from 1 10000000:01000000:2.0:1788658272.113626:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788658272.113644:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.113651:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.113784:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658272.113797:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077248:0@lo:101: 00000100:00100000:2.0:1788658272.113825:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.113892:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbfa5c2b going to sleep for 11 seconds 00000100:00100000:3.0:1788658272.113921:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025077248 00000100:00100000:3.0:1788658272.113925:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025077248 00000100:00100000:3.0:1788658272.114003:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788658272.114010:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045d25b37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:7465:x1875544025077248:12345-0@lo:101: 00010000:00010000:3.0:1788658272.114017:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658272.114026:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e4da expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.114041:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e4da expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.114048:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ecad1909/0x48e67cc629c6e4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e4da expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.114054:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ecad1909, rc 0) 00000100:00100000:3.0:1788658272.114127:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045d25b37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:7465:x1875544025077248:12345-0@lo:101: Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658272.114132:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788658272.114199:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077248:0@lo:101: 00010000:00010000:2.0:1788658272.114208:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e4da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.114215:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e4da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658272.114226:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788658272.114242:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.114249:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000b77c973d/0x48e67cc629c6e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658272.114255:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788658272.114258:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658272.114263:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a1ec11f4800 10000000:01000000:2.0:1788658272.114265:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788658272.114379:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788658272.114382:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788658272.114398:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 0000000007897950/0x48e67cc629c6e4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.114410:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 0000000007897950/0x48e67cc629c6e4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.114417:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 0000000007897950/0x48e67cc629c6e4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658272.114428:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077376:0@lo:101: 00000100:00100000:2.0:1788658272.114452:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.114471:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbfa5c2b going to sleep for 11 seconds 00000100:00100000:0.0:1788658272.114511:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025077376 00000100:00100000:0.0:1788658272.114516:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025077376 00000100:00100000:1.0:1788658272.114640:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658272.114649:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b02a6db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:7465:x1875544025077376:12345-0@lo:101: 00010000:00010000:1.0:1788658272.114667:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658272.114676:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049746aba/0x48e67cc629c6e4ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e4e8 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.114689:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049746aba/0x48e67cc629c6e4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e4e8 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.114696:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049746aba/0x48e67cc629c6e4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e4e8 expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.114732:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049746aba, rc 0) 00000100:00100000:1.0:1788658272.114764:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b02a6db9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025077376:12345-0@lo:101: Request processed in 118us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.114770:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788658272.114912:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077376:0@lo:101: 00010000:00010000:2.0:1788658272.114923:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 0000000007897950/0x48e67cc629c6e4e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.114929:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 0000000007897950/0x48e67cc629c6e4e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658272.115007:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077504:0@lo:501: 00000100:00100000:2.0:1788658272.115032:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.115053:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbfa5c2b going to sleep for 11 seconds 00000100:00100000:1.0:1788658272.115105:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025077504 00000100:00100000:1.0:1788658272.115109:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025077504 00000100:00100000:1.0:1788658272.115128:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788658272.115134:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000444a1a3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025077504:12345-0@lo:501: 00000100:00100000:1.0:1788658272.115244:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000444a1a3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025077504:12345-0@lo:501: Request processed in 110us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.115251:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788658272.115419:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077504:0@lo:501: 00000100:00100000:2.0:1788658272.115445:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077632:0@lo:503: 00000100:00100000:2.0:1788658272.115478:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.115503:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbfa5c2b going to sleep for 11 seconds 00000100:00100000:0.0:1788658272.115558:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025077632 00000100:00100000:0.0:1788658272.115563:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025077632 00000100:00100000:0.0:1788658272.115584:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788658272.115590:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0414281 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025077632:12345-0@lo:503: 00000100:00100000:0.0:1788658272.115867:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0414281 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025077632:12345-0@lo:503: Request processed in 277us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.115873:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658272.115946:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077632:0@lo:503: 00000040:00080000:2.0:1788658272.116180:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658272.116249:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077760:0@lo:502: 00000100:00100000:2.0:1788658272.116298:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.116326:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbfa5c2b going to sleep for 11 seconds 00000100:00100000:0.0:1788658272.116450:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025077760 00000100:00100000:0.0:1788658272.116455:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025077760 00000100:00100000:0.0:1788658272.116477:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788658272.116482:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000574faa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025077760:12345-0@lo:502: 00000100:00100000:0.0:1788658272.116648:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000574faa1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025077760:12345-0@lo:502: Request processed in 166us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.116753:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658272.116881:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077760:0@lo:502: 00000040:00080000:2.0:1788658272.117089:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788658272.117115:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1788658272.117129:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1788658272.117141:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1788658272.117154:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1788658272.117166:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1788658272.117179:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1788658272.117191:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1788658272.117203:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1788658272.117215:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1788658272.117228:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1788658272.117241:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1788658272.117254:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1788658272.117268:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1788658272.117360:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1788658272.117386:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1788658272.117400:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1788658272.117411:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1788658272.117423:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1788658272.117434:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1788658272.117445:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1788658272.117455:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1788658272.117467:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1788658272.117490:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077888:0@lo:502: 00000100:00100000:2.0:1788658272.117529:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.117619:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbfa5c2b going to sleep for 11 seconds 00000100:00100000:0.0:1788658272.117855:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025077888 00000100:00100000:0.0:1788658272.117860:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025077888 00000100:00100000:0.0:1788658272.117937:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788658272.117944:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d326987 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025077888:12345-0@lo:502: 00000100:00100000:0.0:1788658272.118038:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d326987 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025077888:12345-0@lo:502: Request processed in 96us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.118054:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658272.118253:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a6f12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025077888:0@lo:502: 00000040:00080000:2.0:1788658272.118320:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1788658272.118330:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788658272.119103:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658272.119114:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658272.119116:0:7477:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788658272.119120:0:7477:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788658272.119123:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658272.119136:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000055f02b65) 00000020:00000080:2.0:1788658272.119154:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788658272.119158:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788658272.119239:0:7477:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658272.119245:0:7477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6e4fd 00000020:00000080:2.0:1788658272.119523:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788658272.119528:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658272.119531:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658272.119532:0:7477:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788658272.119535:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658272.119539:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658272.119540:0:7477:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788658272.119543:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658272.119612:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000388dd3ff) 00000020:00000080:2.0:1788658272.119623:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788658272.119627:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788658272.119629:0:7477:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788658272.119631:0:7477:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788658272.119638:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788658272.119825:0:7477:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b6127ae0 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788658272.119839:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000d0b334c9) 00000020:00000080:2.0:1788658272.119849:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788658272.119914:0:7477:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788658272.119921:0:7477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6e512 00000020:00000080:2.0:1788658272.120028:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788658272.120040:0:7477:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788658272.120044:0:7477:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x48e67cc629c6e519 00080000:01000000:2.0:1788658272.120050:0:7477:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788658272.120053:0:7477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6e520 00080000:10000000:2.0:1788658272.120517:0:7477:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788658272.121252:0:7477:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:3.0:1788658272.207637:0:7477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:3.0:1788658272.208462:0:7477:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788658272.212047:0:7477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788658272.212641:0:7477:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788658272.223165:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788658272.223177:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658272.223181:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658272.223183:0:7477:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788658272.223185:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658272.223190:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658272.223191:0:7477:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788658272.223192:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788658272.223196:0:7477:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:00000080:3.0:1788658272.223218:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658272.223233:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000787d0029) 00000020:00000080:3.0:1788658272.223250:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788658272.223253:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788658272.223316:0:7477:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788658272.223322:0:7477:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788658272.223335:0:7477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6e52e 00010000:00080000:3.0:1788658272.223364:0:7477:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c3e544c3@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.153@tcp at head 00010000:00010000:2.0:1788658272.228060:0:7477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788658272.229497:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788658272.229511:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788658272.229543:0:7477:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788658272.229562:0:7477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6e535 00000100:00080000:3.0:1788658272.229572:0:7477:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658272.229577:0:7477:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000c3e544c3 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658272.229613:0:7477:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000069b0ef7d x1875544025078016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658272.229644:0:7477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788658272.229743:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658272.229748:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658272.229750:0:7477:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788658272.229753:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788658272.229755:0:7477:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788658272.229757:0:7477:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658272.229758:0:7477:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658272.229759:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788658272.229761:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658272.229762:0:7477:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788658272.229765:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658272.229769:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658272.229770:0:7477:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788658272.229773:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788658272.229954:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069b0ef7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025078016:0@lo:38: 00000100:00100000:2.0:1788658272.230022:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:3.0:1788658272.230096:0:7477:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788658272.230112:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658272.230120:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658272.230121:0:7477:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788658272.230124:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658272.230126:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658272.230127:0:7477:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788658272.230129:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788658272.230130:0:7477:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788658272.230154:0:7477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658272.230156:0:7477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658272.230157:0:7477:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788658272.230159:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1788658272.230296:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025078016 00000100:00100000:1.0:1788658272.230303:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025078016 00000100:00100000:1.0:1788658272.230331:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658272.230338:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a6f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025078016:12345-0@lo:38: 00000020:01000000:2.0:1788658272.230353:0:7465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788658272.230392:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788658272.230412:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 0000000007897950/0x48e67cc629c6e4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.230422:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 0000000007897950/0x48e67cc629c6e4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658272.230430:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ec11f4800 from 1 10000000:01000000:2.0:1788658272.230434:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00080000:1.0:1788658272.230438:0:6541:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00010000:00010000:2.0:1788658272.230454:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.230461:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.230468:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788658272.230468:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6e53c 00000004:00100000:1.0:1788658272.230480:0:6541:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788658272.230481:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c11ec6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025078272:0@lo:101: 00000001:00000004:1.0:1788658272.230486:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788658272.230509:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.230529:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057d3659e going to sleep for 11 seconds 00000100:00100000:1.0:1788658272.230545:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008405db62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025078144:0@lo:400: 00000100:00100000:1.0:1788658272.230639:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658272.230646:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025078272 00000100:00100000:0.0:1788658272.230650:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025078272 00000100:00100000:2.0:1788658272.230783:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025078144 00000100:00100000:2.0:1788658272.230788:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025078144 00000100:00100000:2.0:1788658272.230820:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658272.230826:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f0f7f49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025078144:12345-0@lo:400: 00000100:00100000:2.0:1788658272.230875:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f0f7f49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025078144:12345-0@lo:400: Request processed in 49us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658272.230883:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788658272.230916:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008405db62 x1875544025078144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658272.230929:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008405db62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025078144:0@lo:400: 00000100:00100000:0.0:1788658272.231038:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788658272.231045:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e3e7d8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+12:7465:x1875544025078272:12345-0@lo:101: 00010000:00010000:0.0:1788658272.231054:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658272.231064:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067156da1/0x48e67cc629c6e54a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e543 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.231085:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067156da1/0x48e67cc629c6e54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e543 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.231094:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067156da1/0x48e67cc629c6e54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e543 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.231102:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067156da1, rc 0) 00000100:00100000:0.0:1788658272.231137:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e3e7d8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:7465:x1875544025078272:12345-0@lo:101: Request processed in 93us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.231142:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658272.231194:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c11ec6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025078272:0@lo:101: 00010000:00010000:2.0:1788658272.231205:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.231213:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658272.231788:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c11ec6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025078400:0@lo:256: 00000100:00100000:2.0:1788658272.231820:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.232513:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057d3659e going to sleep for 11 seconds 00000100:00100000:3.0:1788658272.236214:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025078400 00000100:00100000:3.0:1788658272.236230:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025078400 00000100:00100000:2.0:1788658272.236459:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658272.236469:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000719cde10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:7465:x1875544025078400:12345-0@lo:256: 20000000:01000000:2.0:1788658272.236496:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 00000100:00080000:3.0:1788658272.237250:0:6541:0:(import.c:65:import_set_state_nolock()) 00000000b7f2d25d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658272.237355:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a6f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875544025078016:12345-0@lo:38: Request processed in 7016us (7332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658272.237389:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 20000000:01000000:2.0:1788658272.237451:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788658272.237455:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788658272.237530:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788658272.237540:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788658272.237548:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788658272.237553:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788658272.237555:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000c3e544c3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788658272.237581:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069b0ef7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025078016:0@lo:38: 00000100:00100000:2.0:1788658272.237605:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000719cde10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:7465:x1875544025078400:12345-0@lo:256: Request processed in 1138us (5784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658272.237613:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788658272.237691:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c11ec6d pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025078400:0@lo:256: 00000100:00100000:1.0:1788658272.237886:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d5f54e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025078528:0@lo:41: 00000100:00100000:1.0:1788658272.237923:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658272.238016:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025078528 00000100:00100000:0.0:1788658272.238021:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025078528 00000100:00100000:0.0:1788658272.238085:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658272.238092:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008405db62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875544025078528:12345-0@lo:41: 00000004:00000024:0.0:1788658272.238116:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788658272.238153:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008405db62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875544025078528:12345-0@lo:41: Request processed in 62us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.238158:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658272.238201:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d5f54e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025078528:0@lo:41: 10000000:01000000:3.0:1788658272.238495:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658272.238519:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.238529:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658272.238537:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ec11f4800 from 1 10000000:01000000:3.0:1788658272.238539:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658272.238564:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.238571:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.238586:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658272.238602:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f4c44237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025078656:0@lo:101: 00000100:00100000:3.0:1788658272.238633:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658272.238854:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025078656 00000100:00100000:1.0:1788658272.238859:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025078656 00000100:00100000:1.0:1788658272.238897:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658272.238904:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b950dddc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:7465:x1875544025078656:12345-0@lo:101: 00010000:00010000:1.0:1788658272.238912:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658272.238923:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004c72d23/0x48e67cc629c6e558 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e551 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.238942:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004c72d23/0x48e67cc629c6e558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e551 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.238963:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004c72d23/0x48e67cc629c6e558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e551 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.238970:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004c72d23, rc 0) 00000100:00100000:1.0:1788658272.238994:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b950dddc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:7465:x1875544025078656:12345-0@lo:101: Request processed in 91us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.238999:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788658272.239162:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b1fbf2f going to sleep for 11 seconds 00000100:00100000:2.0:1788658272.239178:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f4c44237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025078656:0@lo:101: 00010000:00010000:2.0:1788658272.239196:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.239204:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658272.239296:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025078784:0@lo:501: 00000100:00100000:2.0:1788658272.239324:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.239532:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000003480500d going to sleep for 11 seconds 00000100:00100000:3.0:1788658272.239578:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025078784 00000100:00100000:3.0:1788658272.239582:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025078784 00000100:00100000:3.0:1788658272.239612:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788658272.239619:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006545a38b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:7465:x1875544025078784:12345-0@lo:501: 00000100:00100000:3.0:1788658272.239778:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006545a38b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:7465:x1875544025078784:12345-0@lo:501: Request processed in 159us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658272.239785:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788658272.239868:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025078784:0@lo:501: 00000100:00100000:2.0:1788658272.239896:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025078912:0@lo:503: 00000100:00100000:2.0:1788658272.239935:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.239989:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 000000003480500d going to sleep for 11 seconds 00000100:00100000:1.0:1788658272.240025:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025078912 00000100:00100000:1.0:1788658272.240029:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025078912 00000100:00100000:1.0:1788658272.240086:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788658272.240093:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007fe7df7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:7465:x1875544025078912:12345-0@lo:503: 00000040:00080000:1.0:1788658272.240128:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658272.240170:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007fe7df7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:7465:x1875544025078912:12345-0@lo:503: Request processed in 78us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.240177:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788658272.240243:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025078912:0@lo:503: 00000040:00080000:2.0:1788658272.240494:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658272.240545:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788658272.240615:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658272.241473:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788658272.241615:0:7465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788658272.241940:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658272.241952:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.241962:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658272.242012:0:7465:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788658272.242015:0:7465:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1ec11f4800 10000000:01000000:2.0:1788658272.242018:0:7465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1ec11f4800 10000000:01000000:2.0:1788658272.242032:0:7465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658272.242038:0:7465:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ec11f4800 from 1 10000000:01000000:2.0:1788658272.242040:0:7465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658272.242077:0:7465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 0000000065b5f2cd/0x48e67cc629c6e55f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.242084:0:7465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 0000000065b5f2cd/0x48e67cc629c6e55f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.242093:0:7465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 0000000065b5f2cd/0x48e67cc629c6e55f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658272.242112:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079040:0@lo:101: 00000100:00100000:2.0:1788658272.242165:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.242232:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057d3659e going to sleep for 11 seconds 00000100:00100000:1.0:1788658272.242315:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025079040 00000100:00100000:1.0:1788658272.242322:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025079040 00000100:00100000:1.0:1788658272.242373:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658272.242389:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c2b3a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:7465:x1875544025079040:12345-0@lo:101: 00010000:00010000:1.0:1788658272.242402:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658272.242413:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bad38a03/0x48e67cc629c6e566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e55f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.242433:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bad38a03/0x48e67cc629c6e566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e55f expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.242442:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bad38a03/0x48e67cc629c6e566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e55f expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.242458:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bad38a03, rc 0) 00000100:00100000:1.0:1788658272.242494:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c2b3a2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079040:12345-0@lo:101: Request processed in 106us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.242500:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658272.242642:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079040:0@lo:101: 00010000:00010000:2.0:1788658272.242656:0:7465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 0000000065b5f2cd/0x48e67cc629c6e55f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.242664:0:7465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 0000000065b5f2cd/0x48e67cc629c6e55f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658272.242769:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079168:0@lo:501: 00000100:00100000:2.0:1788658272.242795:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.242814:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057d3659e going to sleep for 11 seconds 00000100:00100000:3.0:1788658272.242962:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025079168 00000100:00100000:3.0:1788658272.242966:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025079168 00000100:00100000:3.0:1788658272.243023:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788658272.243030:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000947de0ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079168:12345-0@lo:501: 00000100:00100000:3.0:1788658272.243134:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000947de0ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079168:12345-0@lo:501: Request processed in 105us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658272.243141:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788658272.243198:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079168:0@lo:501: 00000100:00100000:2.0:1788658272.243223:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079296:0@lo:503: 00000100:00100000:2.0:1788658272.243260:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.243375:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000057d3659e going to sleep for 11 seconds 00000100:00100000:1.0:1788658272.243654:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025079296 00000100:00100000:1.0:1788658272.243659:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025079296 00000100:00100000:1.0:1788658272.243679:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658272.243684:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024389fca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079296:12345-0@lo:503: 00000100:00100000:1.0:1788658272.244000:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024389fca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079296:12345-0@lo:503: Request processed in 315us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.244007:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788658272.244081:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079296:0@lo:503: 00000040:00080000:2.0:1788658272.244317:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658272.244475:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079424:0@lo:502: 00000100:00100000:2.0:1788658272.244512:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.244561:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1f69669 going to sleep for 11 seconds 00000100:00100000:1.0:1788658272.244599:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025079424 00000100:00100000:1.0:1788658272.244603:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025079424 00000100:00100000:1.0:1788658272.244665:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788658272.244673:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fe4de43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079424:12345-0@lo:502: 00000100:00100000:1.0:1788658272.244772:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fe4de43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079424:12345-0@lo:502: Request processed in 100us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.244779:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788658272.244830:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079424:0@lo:502: 00000040:00080000:2.0:1788658272.244964:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788658272.244991:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788658272.245006:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788658272.245018:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788658272.245030:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788658272.245041:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788658272.245053:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788658272.245064:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788658272.245076:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788658272.245089:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788658272.245102:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788658272.245114:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788658272.245127:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788658272.245139:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788658272.245152:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788658272.245166:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788658272.245179:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788658272.245193:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788658272.245206:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788658272.245218:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788658272.245231:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788658272.245245:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788658272.245272:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788658272.245288:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788658272.245312:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788658272.245322:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788658272.245333:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788658272.245345:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788658272.245366:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079552:0@lo:502: 00000100:00100000:2.0:1788658272.245411:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.245522:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1f69669 going to sleep for 11 seconds 00000100:00100000:3.0:1788658272.245559:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025079552 00000100:00100000:3.0:1788658272.245565:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025079552 00000100:00100000:3.0:1788658272.245589:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658272.245596:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea809971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079552:12345-0@lo:502: 00000100:00100000:3.0:1788658272.245734:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea809971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079552:12345-0@lo:502: Request processed in 138us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658272.245755:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788658272.245829:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079552:0@lo:502: 00000040:00080000:2.0:1788658272.245865:0:7465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788658272.245874:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788658272.246256:0:7483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788658272.246279:0:7483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000a5b605e0) 00000020:00000080:2.0:1788658272.246300:0:7483:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788658272.246397:0:7483:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b6127ae0 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788658272.246401:0:7483:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b6127ae0 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788658272.246403:0:7483:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b6127ae0 3 00010000:00080000:2.0:1788658272.246427:0:7483:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a65439b2@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.153@tcp at head 00010000:00010000:2.0:1788658272.248586:0:7483:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788658272.248887:0:7483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788658272.248929:0:7483:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788658272.248940:0:7483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x48e67cc629c6e574 00000100:00080000:2.0:1788658272.248949:0:7483:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658272.248953:0:7483:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000a65439b2 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658272.248986:0:7483:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002958222b x1875544025079680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658272.249035:0:7483:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1788658272.249560:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788658272.249611:0:7465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788658272.249643:0:7465:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788658272.249657:0:7465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 0000000065b5f2cd/0x48e67cc629c6e55f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.249667:0:7465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 0000000065b5f2cd/0x48e67cc629c6e55f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788658272.249739:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788658272.249742:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788658272.249743:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658272.249744:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658272.249745:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658272.249746:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658272.249748:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658272.249749:0:7465:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788658272.249750:0:7465:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788658272.249752:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658272.249754:0:7465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788658272.249758:0:7465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788658272.249761:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788658272.249763:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788658272.249764:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658272.249765:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658272.249766:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658272.249767:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658272.249768:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658272.249769:0:7465:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788658272.249770:0:7465:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788658272.249771:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658272.249772:0:7465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788658272.249790:0:7465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788658272.249805:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069df3d24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079808:0@lo:253: 00000100:00100000:3.0:1788658272.249891:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658272.249930:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012437fef going to sleep for 11 seconds 00000100:00100000:3.0:1788658272.249953:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025079808 00000100:00100000:3.0:1788658272.249959:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025079808 00000100:00100000:3.0:1788658272.250000:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788658272.250007:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cb1f873 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079808:12345-0@lo:253: 20000000:01000000:3.0:1788658272.250031:0:6531:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788658272.250045:0:6531:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:2.0:1788658272.250276:0:7484:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1788658272.250400:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875544025079680:0@lo:38: 00000100:00100000:0.0:1788658272.250438:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1788658272.251760:0:6515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788658272.254490:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025079680 00000100:00100000:3.0:1788658272.254504:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025079680 00000100:00100000:3.0:1788658272.254546:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658272.254553:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011449ea3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025079680:12345-0@lo:38: 00010000:00080000:3.0:1788658272.254581:0:6537:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1788658272.254618:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x48e67cc629c6e57b 00000004:00100000:3.0:1788658272.254633:0:6537:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788658272.254670:0:6537:0:(import.c:65:import_set_state_nolock()) 00000000817162ce : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658272.254778:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011449ea3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875544025079680:12345-0@lo:38: Request processed in 224us (4339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658272.254785:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:3.0:1788658272.254835:0:6531:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788658272.254844:0:6531:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788658272.254935:0:6552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788658272.254940:0:6552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788658272.254958:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.254974:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fe1867ca/0x48e67cc629c6e4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e49b expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.254989:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000067156da1/0x48e67cc629c6e54a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e543 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.254997:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.255031:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000067156da1/0x48e67cc629c6e54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e543 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.255043:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000067156da1/0x48e67cc629c6e54a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e543 expref: 15 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658272.255054:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f59971 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025079936:0@lo:104: 00000100:00100000:3.0:1788658272.255092:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658272.255178:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fe1867ca/0x48e67cc629c6e4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e49b expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658272.255186:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fe1867ca/0x48e67cc629c6e4a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e49b expref: 15 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658272.255193:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009bcb4d79 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025080064:0@lo:104: 00000100:00100000:3.0:1788658272.255213:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658272.255227:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set 000000000b1fbf2f going to sleep for 11 seconds 00000100:00100000:3.0:1788658272.255279:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cb1f873 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7465:x1875544025079808:12345-0@lo:253: Request processed in 5273us (5389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658272.255287:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788658272.255334:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069df3d24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7465:1875544025079808:0@lo:253: 10000000:01000000:3.0:1788658272.255345:0:7465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788658272.255354:0:7465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658272.255356:0:7465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788658272.255357:0:7465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658272.255358:0:7465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658272.255359:0:7465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658272.255360:0:7465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658272.255361:0:7465:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658272.255363:0:7465:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788658272.255364:0:7465:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788658272.255365:0:7465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658272.255367:0:7465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788658272.255392:0:7465:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788658272.256081:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025079936 00000100:00100000:1.0:1788658272.256089:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025079936 00000100:00100000:1.0:1788658272.256117:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025080064 00000100:00100000:1.0:1788658272.256120:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025080064 00000100:00100000:1.0:1788658272.256133:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658272.256140:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdddc7b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6552:x1875544025079936:12345-0@lo:104: 00010000:00010000:1.0:1788658272.256151:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.257465:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658272.257473:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdddc7b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6552:x1875544025079936:12345-0@lo:104: Request processed in 1332us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.257480:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788658272.257487:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002958222b x1875544025079680/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658272.257498:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1788658272.257505:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788658272.257506:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00100000:1.0:1788658272.257511:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab288c5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6552:x1875544025080064:12345-0@lo:104: 00000100:00080000:0.0:1788658272.257513:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788658272.257518:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00010000:00010000:1.0:1788658272.257521:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658272.257521:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000a65439b2 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788658272.257527:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002958222b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875544025079680:0@lo:38: 00010000:00010000:1.0:1788658272.257553:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788658272.257615:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab288c5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6552:x1875544025080064:12345-0@lo:104: Request processed in 48us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.257622:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658272.257653:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f59971 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025079936:0@lo:104: 00000100:00100000:1.0:1788658272.257661:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009bcb4d79 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025080064:0@lo:104: 00010000:00010000:0.0:1788658272.257668:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658272.257673:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.257677:0:6552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.257681:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000237738c6 already unused, calling callback (00000000affb3be2) 10000000:00010000:0.0:1788658272.257684:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.257690:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658272.257691:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658272.257730:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658272.257736:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658272.257771:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.257777:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658272.257795:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.257800:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000237738c6/0x48e67cc629c6e543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e54a expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658272.257813:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658272.257815:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658272.257816:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658272.257828:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e3d0b2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025080192:0@lo:103: 00000100:00100000:0.0:1788658272.257865:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658272.257908:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025080192 00000100:00100000:1.0:1788658272.257914:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025080192 00010000:00010000:1.0:1788658272.257933:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000067156da1/0x48e67cc629c6e54a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e543 expref: 15 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658272.257957:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658272.257963:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f83ab173 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:3648:x1875544025080192:12345-0@lo:103: 00010000:00010000:1.0:1788658272.257980:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658272.257983:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000067156da1/0x48e67cc629c6e54a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e543 expref: 15 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.257992:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000067156da1/0x48e67cc629c6e54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e543 expref: 15 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258005:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067156da1/0x48e67cc629c6e54a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e543 expref: 15 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258015:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658272.258049:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f83ab173 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:3648:x1875544025080192:12345-0@lo:103: Request processed in 87us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.258055:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658272.258159:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e3d0b2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025080192:0@lo:103: 00010000:00010000:2.0:1788658272.258336:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658272.258344:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658272.258346:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658272.258350:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258358:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000081c85d5 already unused, calling callback (00000000affb3be2) 10000000:00010000:1.0:1788658272.258360:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258366:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658272.258371:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658272.258376:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658272.258414:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258431:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658272.258453:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258460:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000081c85d5/0x48e67cc629c6e49b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e4a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258473:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658272.258474:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658272.258476:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658272.258479:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb783880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025080320:0@lo:103: 00000100:00100000:0.0:1788658272.258507:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658272.258529:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025080320 00000100:00100000:1.0:1788658272.258533:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025080320 00010000:00010000:1.0:1788658272.258547:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fe1867ca/0x48e67cc629c6e4a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e49b expref: 14 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658272.258645:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658272.258652:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae95da19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:3649:x1875544025080320:12345-0@lo:103: 00010000:00010000:1.0:1788658272.258660:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658272.258664:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fe1867ca/0x48e67cc629c6e4a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e49b expref: 14 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258672:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fe1867ca/0x48e67cc629c6e4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e49b expref: 14 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258681:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fe1867ca/0x48e67cc629c6e4a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e49b expref: 14 pid: 6531 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258693:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258801:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788658272.258816:0:6522:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003877363s 00010000:00010000:1.0:1788658272.258820:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258827:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258833:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258839:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258844:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005f1cff9a already unused, calling callback (00000000a732b953) 00010000:00010000:1.0:1788658272.258847:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258854:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258868:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658272.258878:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658272.258907:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae95da19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:3649:x1875544025080320:12345-0@lo:103: Request processed in 257us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.258913:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788658272.259007:0:6552:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.259015:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658272.259021:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f1cff9a/0x48e67cc629c6e582 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788658272.260290:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788658272.260512:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788658272.260735:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00000100:00100000:1.0:1788658272.260835:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb783880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025080320:0@lo:103: 00080000:10000000:3.0:1788658272.260903:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788658272.261078:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788658272.261222:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788658272.264296:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788658272.266543:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788658272.266912:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788658272.267085:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788658272.267263:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788658272.267473:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788658272.269112:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788658272.269159:0:7489:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788658272.269168:0:7489:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788658272.269308:0:7490:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788658272.269312:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788658272.269356:0:7490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069df3d24 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7490:1875544025080448:0@lo:700: 00000100:00100000:3.0:1788658272.269435:0:7490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.269477:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025080448 00000100:00100000:3.0:1788658272.269484:0:7490:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089ae7e45 going to sleep for 11 seconds 00000100:00100000:2.0:1788658272.269485:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025080448 00000100:00100000:2.0:1788658272.269534:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658272.269543:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bcb4d79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7490:x1875544025080448:12345-0@lo:700: 00000100:00100000:0.0:1788658272.270000:0:7491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e3d0b2c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7491:1875544025080576:0@lo:1000: 00000100:00100000:0.0:1788658272.270033:0:7491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658272.270088:0:7491:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d4f0ecf going to sleep for 11 seconds 00000100:00100000:1.0:1788658272.270120:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025080576 00000100:00100000:1.0:1788658272.270124:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025080576 00000100:00100000:1.0:1788658272.270186:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658272.270194:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ae2ec0d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7491:x1875544025080576:12345-0@lo:1000: 00000100:00100000:1.0:1788658272.270284:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ae2ec0d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7491:x1875544025080576:12345-0@lo:1000: Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.270291:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658272.270359:0:7491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e3d0b2c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7491:1875544025080576:0@lo:1000: 00000040:01000000:3.0:1788658272.270374:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:01000000:2.0:1788658272.270396:0:7491:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788658272.270416:0:7491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b2e1975 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7491:1875544025080704:0@lo:700: 00000100:00100000:2.0:1788658272.270442:0:7491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.270461:0:7491:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d38d2b1 going to sleep for 11 seconds 00000040:00080000:3.0:1788658272.270490:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658272.270756:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025080704 00000100:00100000:0.0:1788658272.270762:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025080704 00000100:00100000:0.0:1788658272.270829:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658272.270836:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000644b6b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7491:x1875544025080704:12345-0@lo:700: 00000100:00100000:0.0:1788658272.270877:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000644b6b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7491:x1875544025080704:12345-0@lo:700: Request processed in 43us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.270884:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658272.270996:0:7491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b2e1975 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7491:1875544025080704:0@lo:700: 00000100:00100000:1.0:1788658272.271034:0:7491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb783880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7491:1875544025080832:0@lo:900: 00000004:00000080:3.0:1788658272.271050:0:7465:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788658272.271057:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1788658272.271069:0:7491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658272.271096:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025080832 00000100:00100000:1.0:1788658272.271099:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025080832 00000100:00100000:1.0:1788658272.271123:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658272.271128:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e14dcd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7491:x1875544025080832:12345-0@lo:900: 00000100:00100000:1.0:1788658272.271158:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e14dcd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7491:x1875544025080832:12345-0@lo:900: Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.271164:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658272.271185:0:7491:0:(client.c:2716:ptlrpc_set_wait()) set 0000000006cf9f1f going to sleep for 11 seconds 00010000:00080000:1.0:1788658272.271198:0:7491:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cb783880 x1875544025080832/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788658288 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000040:00080000:3.0:1788658272.271199:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658272.271208:0:7491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb783880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7491:1875544025080832:0@lo:900: 00000100:00100000:1.0:1788658272.271265:0:7491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb783880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7491:1875544025080960:0@lo:1000: 00000100:00100000:1.0:1788658272.271288:0:7491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658272.271306:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025080960 00000100:00100000:1.0:1788658272.271313:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025080960 00000100:00100000:1.0:1788658272.271332:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658272.271337:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015e7c0bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7491:x1875544025080960:12345-0@lo:1000: 00000100:00100000:1.0:1788658272.271394:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015e7c0bd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7491:x1875544025080960:12345-0@lo:1000: Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.271400:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658272.271464:0:7491:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee9252ef going to sleep for 11 seconds 00000100:00100000:1.0:1788658272.271474:0:7491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb783880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7491:1875544025080960:0@lo:1000: 00000004:00080000:1.0:1788658272.271502:0:7491:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000006cf9f1f with version 0 00000020:00100000:1.0:1788658272.271513:0:7491:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788658272.271517:0:7491:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cb783880 x1875544025081216/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658272.271527:0:7491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb783880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7491:1875544025081216:0@lo:1000: 00000100:00100000:1.0:1788658272.271546:0:7491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658272.271561:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025081216 00000100:00100000:1.0:1788658272.271564:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025081216 00000100:00100000:1.0:1788658272.271581:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658272.271586:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004751d429 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7491:x1875544025081216:12345-0@lo:1000: 00000100:00100000:1.0:1788658272.271871:0:7491:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e2a476f going to sleep for 11 seconds 00000040:00080000:3.0:1788658272.272834:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788658272.273227:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788658272.273260:0:7465:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788658272.273432:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788658272.273982:0:7465:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788658272.274643:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788658272.275492:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788658272.275644:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788658272.275826:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788658272.275980:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788658272.276171:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000001:00080000:0.0:1788658272.276289:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00100000:10000000:2.0:1788658272.276312:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 40000000:02000000:0.0:1788658272.276323:0:6543:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1788658272.276446:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788658272.276605:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788658272.276765:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788658272.276912:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788658272.277042:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788658272.277196:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788658272.277324:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000100:00100000:3.0:1788658272.277634:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004751d429 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7491:x1875544025081216:12345-0@lo:1000: Request processed in 6043us (6083us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788658272.277647:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1788658272.277884:0:7491:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788658272.277889:0:7491:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788658272.277905:0:7491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb783880 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7491:1875544025081216:0@lo:1000: 00000100:00100000:3.0:1788658272.277989:0:7491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f59971 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7491:1875544025081344:0@lo:1000: 00000100:00100000:3.0:1788658272.278027:0:7491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658272.278050:0:7491:0:(client.c:2716:ptlrpc_set_wait()) set 000000000de021c3 going to sleep for 11 seconds 00000100:00100000:1.0:1788658272.278115:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025081344 00000100:00100000:1.0:1788658272.278122:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025081344 00000100:00100000:1.0:1788658272.278203:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658272.278211:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4c44237 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7491:x1875544025081344:12345-0@lo:1000: 00000100:00100000:1.0:1788658272.278272:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4c44237 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7491:x1875544025081344:12345-0@lo:1000: Request processed in 62us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658272.278278:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:2.0:1788658272.278462:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788658272.278588:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788658272.278900:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788658272.279011:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788658272.279179:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788658272.279321:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788658272.279466:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788658272.279585:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788658272.279694:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788658272.279882:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788658272.280021:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788658272.280141:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788658272.280266:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788658272.280421:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788658272.280551:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788658272.280690:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788658272.280839:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788658272.281003:0:7465:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788658272.281197:0:7465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788658272.281626:0:7491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f59971 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7491:1875544025081344:0@lo:1000: 00000040:00080000:1.0:1788658272.281666:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788658272.281719:0:7491:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002f14f611 with version 1 00000040:00080000:1.0:1788658272.283861:0:7491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788658272.283950:0:7491:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788658272.284350:0:7480:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000074f43677 version 1 rpc_version 1 00000020:00100000:2.0:1788658272.284398:0:7480:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788658272.284408:0:7480:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cf40b32b x1875544025081600/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658272.284429:0:7480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7480:1875544025081600:0@lo:1000: 00000100:00100000:2.0:1788658272.284516:0:7480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658272.284566:0:7480:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1f69669 going to sleep for 11 seconds 00000100:00100000:3.0:1788658272.284669:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025081600 00000100:00100000:3.0:1788658272.284676:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025081600 00000100:00100000:3.0:1788658272.284744:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658272.284753:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003619da06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875544025081600:12345-0@lo:1000: 00000001:00080000:2.0:1788658272.293948:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1788658272.294336:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003619da06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7480:x1875544025081600:12345-0@lo:1000: Request processed in 9581us (9817us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788658272.294350:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788658272.294450:0:7480:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788658272.294454:0:7480:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788658272.294470:0:7480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7480:1875544025081600:0@lo:1000: 00000001:00080000:2.0:1788658272.299780:0:7465:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788658272.299824:0:7465:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa33e41c87988 00100000:10000000:2.0:1788658272.299832:0:7465:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788658272.300445:0:7465:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788658272.300482:0:7465:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788658272.300506:0:7465:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788658272.300525:0:7465:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00010000:00080000:3.0:1788658272.300783:0:7490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000069df3d24 x1875544025080448/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788658288 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658272.300809:0:7490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069df3d24 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7490:1875544025080448:0@lo:700: 40000000:02000000:3.0:1788658272.300830:0:7490:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:0.0:1788658272.302483:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bcb4d79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7490:x1875544025080448:12345-0@lo:700: Request processed in 32921us (33028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658272.302826:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000004:2.0:1788658272.317967:0:7465:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658272.319420:0:7465:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:1.0:1788658272.359455:0:7490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658272.379560:0:7490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788658272.379691:0:7490:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788658272.379698:0:7490:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1788658272.705183:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658273.736843:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658274.758359:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658275.780936:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658276.800635:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658277.311513:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b791664f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025081728:0@lo:400: 00000100:00100000:1.0:1788658277.311628:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658277.311692:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658277.311698:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8e0bf7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025082112:0@lo:400: 00000100:00100000:1.0:1788658277.311750:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658277.311792:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000499f34f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025081856:0@lo:400: 00000100:00100000:1.0:1788658277.311893:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658277.311918:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658277.311922:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005de05aca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025081984:0@lo:400: 00000100:00100000:1.0:1788658277.311949:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658277.311995:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025082112 00000100:00100000:1.0:1788658277.312005:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025082112 00000100:00100000:1.0:1788658277.312056:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025081856 00000100:00100000:1.0:1788658277.312059:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025081856 00000100:00100000:1.0:1788658277.312076:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658277.312084:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006584c356 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025082112:12345-0@lo:400: 00000100:00100000:1.0:1788658277.312147:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006584c356 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025082112:12345-0@lo:400: Request processed in 64us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658277.312154:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658277.312175:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658277.312180:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090a0851f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025081856:12345-0@lo:400: 00000100:00100000:1.0:1788658277.313099:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090a0851f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025081856:12345-0@lo:400: Request processed in 911us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658277.313117:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658277.313182:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025081984 00000100:00100000:1.0:1788658277.313192:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025081984 00000100:00100000:0.0:1788658277.313624:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025081728 00000100:00100000:0.0:1788658277.313635:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025081728 00000100:00100000:0.0:1788658277.313730:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788658277.313738:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f436a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:3650:x1875544025081728:12345-0@lo:400: 00000100:00100000:0.0:1788658277.313805:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f436a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:3650:x1875544025081728:12345-0@lo:400: Request processed in 66us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658277.313841:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788658277.314067:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658277.314091:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003616e909 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025082240:0@lo:41: 00000100:00100000:0.0:1788658277.314160:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658277.314237:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025082240 00000100:00100000:0.0:1788658277.314245:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025082240 00000100:00100000:0.0:1788658277.314286:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658277.314297:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf958717 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875544025082240:12345-0@lo:41: 00000004:00000024:0.0:1788658277.314353:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788658277.314423:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf958717 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875544025082240:12345-0@lo:41: Request processed in 127us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658277.314432:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658277.314593:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003616e909 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025082240:0@lo:41: 00010000:00080000:0.0:1788658277.314736:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b8e0bf7a x1875544025082112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658277.314749:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8e0bf7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025082112:0@lo:400: 00000100:00100000:0.0:1788658277.314765:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b791664f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025081728:0@lo:400: 00010000:00080000:0.0:1788658277.314838:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000499f34f4 x1875544025081856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658277.314851:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000499f34f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025081856:0@lo:400: 00000100:00100000:1.0:1788658277.315900:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658277.315911:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4bfa5d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025081984:12345-0@lo:400: 00000100:00100000:1.0:1788658277.316002:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4bfa5d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025081984:12345-0@lo:400: Request processed in 92us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658277.316008:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658277.316052:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005de05aca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025081984:0@lo:400: 00010000:00010000:2.0:1788658277.828697:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658278.855698:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658278.941092:0:7736:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788658279.871973:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788658279.885444:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788658279.885456:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ec11f4800 from 4 10000000:01000000:2.0:1788658279.885462:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658279.885587:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000c8877d16/0x48e67cc629c6e589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.885696:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000c8877d16/0x48e67cc629c6e589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.885731:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000c8877d16/0x48e67cc629c6e589 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658279.885763:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025082368:0@lo:101: 00000100:00100000:2.0:1788658279.885853:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.885924:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c28fd41f going to sleep for 11 seconds 00000100:00100000:0.0:1788658279.886006:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025082368 00000100:00100000:0.0:1788658279.886017:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025082368 00000100:00100000:0.0:1788658279.886084:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788658279.886093:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c1c052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:6534:x1875544025082368:12345-0@lo:101: 00010000:00010000:0.0:1788658279.886108:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658279.886123:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000088529bfa/0x48e67cc629c6e590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e589 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658279.886159:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088529bfa/0x48e67cc629c6e590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e589 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658279.886169:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000088529bfa/0x48e67cc629c6e590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e589 expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658279.886179:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000088529bfa, rc 0) 00000100:00100000:0.0:1788658279.886221:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c1c052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:6534:x1875544025082368:12345-0@lo:101: Request processed in 130us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658279.886228:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788658279.887925:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025082368:0@lo:101: 00010000:00010000:2.0:1788658279.887956:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000c8877d16/0x48e67cc629c6e589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.887968:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000c8877d16/0x48e67cc629c6e589 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658279.888055:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025082496:0@lo:256: 00000100:00100000:2.0:1788658279.888132:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.888216:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c28fd41f going to sleep for 11 seconds 00000100:00100000:0.0:1788658279.894868:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025082496 00000100:00100000:0.0:1788658279.894894:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025082496 00000100:00100000:2.0:1788658279.895870:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658279.895887:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c53eb5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:6534:x1875544025082496:12345-0@lo:256: 20000000:01000000:2.0:1788658279.895945:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788658279.895965:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788658279.895969:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788658279.896146:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c53eb5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:6534:x1875544025082496:12345-0@lo:256: Request processed in 263us (8014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658279.896163:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658279.896229:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025082496:0@lo:256: 10000000:01000000:2.0:1788658279.896487:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788658279.896499:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000c8877d16/0x48e67cc629c6e589 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.896582:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000c8877d16/0x48e67cc629c6e589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658279.896837:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788658279.896841:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ec1212800 from 21 10000000:01000000:2.0:1788658279.896845:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658279.896885:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 000000009e3afcc3/0x48e67cc629c6e597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.896894:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 000000009e3afcc3/0x48e67cc629c6e597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.896904:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 000000009e3afcc3/0x48e67cc629c6e597 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658279.896925:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025082624:0@lo:101: 00000100:00100000:2.0:1788658279.896971:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.897010:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c28fd41f going to sleep for 11 seconds 00000100:00100000:0.0:1788658279.897026:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025082624 00000100:00100000:0.0:1788658279.897035:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025082624 00000100:00100000:0.0:1788658279.897083:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788658279.897092:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055f8f96c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:6534:x1875544025082624:12345-0@lo:101: 00010000:00010000:0.0:1788658279.897105:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658279.897123:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2a08bd0/0x48e67cc629c6e59e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e597 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658279.897152:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2a08bd0/0x48e67cc629c6e59e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e597 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658279.897164:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2a08bd0/0x48e67cc629c6e59e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e597 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658279.897173:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2a08bd0, rc 0) 00000100:00100000:0.0:1788658279.897218:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055f8f96c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025082624:12345-0@lo:101: Request processed in 128us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658279.897233:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788658279.897410:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025082624:0@lo:101: 00010000:00010000:2.0:1788658279.897423:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 000000009e3afcc3/0x48e67cc629c6e597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.897442:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 000000009e3afcc3/0x48e67cc629c6e597 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658279.898039:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025082752:0@lo:501: 00000100:00100000:2.0:1788658279.898079:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.898114:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c28fd41f going to sleep for 11 seconds 00000100:00100000:1.0:1788658279.898162:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025082752 00000100:00100000:1.0:1788658279.898168:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025082752 00000100:00100000:1.0:1788658279.898211:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658279.898219:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005daa25df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025082752:12345-0@lo:501: 00000100:00100000:2.0:1788658279.898615:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025082752:0@lo:501: 00000100:00100000:2.0:1788658279.898654:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025082880:0@lo:503: 00000100:00100000:2.0:1788658279.898731:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.898755:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c28fd41f going to sleep for 11 seconds 00000100:00100000:1.0:1788658279.898881:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005daa25df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025082752:12345-0@lo:501: Request processed in 284us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658279.898892:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658279.898921:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025082880 00000100:00100000:1.0:1788658279.898925:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025082880 00000100:00100000:1.0:1788658279.898957:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658279.898963:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca4091b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025082880:12345-0@lo:503: 00000100:00100000:1.0:1788658279.899061:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca4091b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025082880:12345-0@lo:503: Request processed in 98us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658279.899068:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788658279.899354:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025082880:0@lo:503: 00000100:00100000:0.0:1788658279.900205:0:7775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003616e909 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7775:1875544025083008:0@lo:502: 00000100:00100000:0.0:1788658279.900479:0:7775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658279.900821:0:7775:0:(client.c:2716:ptlrpc_set_wait()) set 00000000875044c7 going to sleep for 11 seconds 00000100:00100000:1.0:1788658279.900905:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025083008 00000100:00100000:1.0:1788658279.900914:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025083008 00000100:00100000:1.0:1788658279.900963:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788658279.900971:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000753e4692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7775:x1875544025083008:12345-0@lo:502: 00000100:00100000:1.0:1788658279.901126:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000753e4692 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7775:x1875544025083008:12345-0@lo:502: Request processed in 155us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658279.901135:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788658279.901346:0:7775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003616e909 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7775:1875544025083008:0@lo:502: 00000100:00100000:0.0:1788658279.901417:0:7775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003616e909 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7775:1875544025083136:0@lo:502: 00000100:00100000:0.0:1788658279.901459:0:7775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658279.901535:0:7775:0:(client.c:2716:ptlrpc_set_wait()) set 00000000875044c7 going to sleep for 11 seconds 00000100:00100000:2.0:1788658279.902253:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025083136 00000100:00100000:2.0:1788658279.902263:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025083136 00000100:00100000:2.0:1788658279.902420:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788658279.902431:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0436210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7775:x1875544025083136:12345-0@lo:502: 00000100:00100000:2.0:1788658279.902593:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0436210 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:7775:x1875544025083136:12345-0@lo:502: Request processed in 164us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658279.902615:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788658279.902757:0:7775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003616e909 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7775:1875544025083136:0@lo:502: 00000040:00080000:0.0:1788658279.902795:0:7775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788658279.906592:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788658279.906645:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788658279.906659:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 000000009e3afcc3/0x48e67cc629c6e597 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658279.906731:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 000000009e3afcc3/0x48e67cc629c6e597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658279.906745:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658279.906748:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ec1212800 from 4 10000000:01000000:3.0:1788658279.906751:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658279.906803:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 000000008a55de33/0x48e67cc629c6e5a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658279.906811:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 000000008a55de33/0x48e67cc629c6e5a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658279.906824:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 000000008a55de33/0x48e67cc629c6e5a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658279.906853:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069df3d24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025083264:0@lo:101: 00000100:00100000:3.0:1788658279.906954:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658279.909368:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 000000006898d23c going to sleep for 11 seconds 00000100:00100000:1.0:1788658279.915953:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025083264 00000100:00100000:1.0:1788658279.915981:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025083264 00000100:00100000:1.0:1788658279.916064:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788658279.916075:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9b99373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025083264:12345-0@lo:101: 00010000:00010000:1.0:1788658279.916104:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658279.916137:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013d3c4c1/0x48e67cc629c6e5ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e5a5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658279.916182:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013d3c4c1/0x48e67cc629c6e5ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e5a5 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658279.916195:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013d3c4c1/0x48e67cc629c6e5ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e5a5 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658279.916209:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013d3c4c1, rc 0) 00000100:00100000:1.0:1788658279.916330:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9b99373 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025083264:12345-0@lo:101: Request processed in 257us (9376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658279.916338:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788658279.923003:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069df3d24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025083264:0@lo:101: 00010000:00010000:2.0:1788658279.923054:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 000000008a55de33/0x48e67cc629c6e5a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.923072:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 000000008a55de33/0x48e67cc629c6e5a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658279.923195:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025083392:0@lo:256: 00000100:00100000:2.0:1788658279.923310:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658279.925164:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 000000001433b093 going to sleep for 11 seconds 00000100:00100000:0.0:1788658279.927515:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025083392 00000100:00100000:0.0:1788658279.927550:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025083392 00000100:00100000:0.0:1788658279.927666:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788658279.927689:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2805819 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025083392:12345-0@lo:256: 20000000:01000000:0.0:1788658279.927757:0:6531:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788658279.927783:0:6531:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788658279.927787:0:6531:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788658279.928170:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2805819 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025083392:12345-0@lo:256: Request processed in 493us (4860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658279.928180:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788658279.928899:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025083392:0@lo:256: 10000000:01000000:2.0:1788658279.933923:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788658279.933943:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 000000008a55de33/0x48e67cc629c6e5a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.933971:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 000000008a55de33/0x48e67cc629c6e5a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658279.933983:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788658279.933986:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788658279.933990:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788658279.934152:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 00000000693de47a/0x48e67cc629c6e5b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.934162:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 00000000693de47a/0x48e67cc629c6e5b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.934176:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 00000000693de47a/0x48e67cc629c6e5b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658279.934205:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025083520:0@lo:101: 00000100:00100000:2.0:1788658279.934292:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658279.934374:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025083520 00000100:00100000:1.0:1788658279.934386:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025083520 00000100:00100000:2.0:1788658279.934425:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016de7172 going to sleep for 11 seconds 00000100:00100000:1.0:1788658279.934455:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788658279.934466:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8d917e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025083520:12345-0@lo:101: 00010000:00010000:1.0:1788658279.934492:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658279.934519:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aec10554/0x48e67cc629c6e5ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e5b3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658279.934553:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aec10554/0x48e67cc629c6e5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e5b3 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658279.934565:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aec10554/0x48e67cc629c6e5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e5b3 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658279.934574:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aec10554, rc 0) 00000100:00100000:1.0:1788658279.934633:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8d917e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025083520:12345-0@lo:101: Request processed in 169us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658279.934641:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658279.934728:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025083520:0@lo:101: 00010000:00010000:2.0:1788658279.934745:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 00000000693de47a/0x48e67cc629c6e5b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.934766:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 00000000693de47a/0x48e67cc629c6e5b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658279.934835:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025083648:0@lo:501: 00000100:00100000:2.0:1788658279.934862:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.934879:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016de7172 going to sleep for 11 seconds 00000100:00100000:2.0:1788658279.934897:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025083648 00000100:00100000:2.0:1788658279.934901:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025083648 00000100:00100000:2.0:1788658279.934939:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788658279.934946:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023cb3084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025083648:12345-0@lo:501: 00000100:00100000:2.0:1788658279.935287:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023cb3084 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025083648:12345-0@lo:501: Request processed in 340us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658279.935295:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788658279.935329:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025083648:0@lo:501: 00000100:00100000:2.0:1788658279.935370:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025083776:0@lo:503: 00000100:00100000:2.0:1788658279.935410:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.935425:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000016de7172 going to sleep for 11 seconds 00000100:00100000:2.0:1788658279.935437:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025083776 00000100:00100000:2.0:1788658279.935441:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025083776 00000100:00100000:2.0:1788658279.935463:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788658279.935468:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036547fef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025083776:12345-0@lo:503: 00000100:00100000:2.0:1788658279.935554:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036547fef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025083776:12345-0@lo:503: Request processed in 85us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658279.935560:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788658279.935807:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025083776:0@lo:503: 00000100:00100000:1.0:1788658279.936219:0:7778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005de05aca pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7778:1875544025083904:0@lo:502: 00000100:00100000:1.0:1788658279.936263:0:7778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658279.936299:0:7778:0:(client.c:2716:ptlrpc_set_wait()) set 000000008da74678 going to sleep for 11 seconds 00000100:00100000:2.0:1788658279.936414:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025083904 00000100:00100000:2.0:1788658279.936420:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025083904 00000100:00100000:2.0:1788658279.936459:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788658279.936466:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a437b9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:7778:x1875544025083904:12345-0@lo:502: 00000100:00100000:2.0:1788658279.936638:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a437b9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:7778:x1875544025083904:12345-0@lo:502: Request processed in 172us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658279.936646:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788658279.937067:0:7778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005de05aca pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7778:1875544025083904:0@lo:502: 00000020:01000000:1.0:1788658279.937110:0:7778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658279.937127:0:7778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658279.937130:0:7778:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788658279.937136:0:7778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788658279.937140:0:7778:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:00000080:1.0:1788658279.937168:0:7778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658279.937187:0:7778:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000001e28be3f) 00000020:00000080:1.0:1788658279.937214:0:7778:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788658279.937222:0:7778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788658279.937342:0:7778:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788658279.938483:0:7778:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788658279.939478:0:7778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6e5c8 00010000:00080000:1.0:1788658279.939671:0:7778:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000be18f82c@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1788658279.951203:0:7778:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788658279.954470:0:7778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658279.954491:0:7778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788658279.954547:0:7778:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788658279.954586:0:7778:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6e5cf 00000100:00080000:1.0:1788658279.954600:0:7778:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658279.954607:0:7778:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000be18f82c using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658279.954655:0:7778:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005de05aca x1875544025084032/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658279.954750:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005de05aca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025084032:0@lo:38: 00000100:00100000:3.0:1788658279.954854:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.954972:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025084032 00000100:00100000:2.0:1788658279.954984:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025084032 00000100:00100000:2.0:1788658279.955026:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658279.955035:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069b0ef7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025084032:12345-0@lo:38: 00010000:00080000:2.0:1788658279.955069:0:6541:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000100:00080000:1.0:1788658279.955131:0:7778:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1788658279.955201:0:7778:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00000080:2.0:1788658279.955448:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6e5d6 00000004:00100000:2.0:1788658279.955470:0:6541:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788658279.955480:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788658279.955969:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025084160:0@lo:400: 00000100:00100000:1.0:1788658279.956040:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658279.956078:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658279.956084:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025084288:0@lo:400: 00000100:00100000:1.0:1788658279.956110:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658279.956139:0:6542:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788658279.956149:0:6542:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788658279.956270:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025084160 00000100:00100000:3.0:1788658279.956277:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025084160 00000100:00100000:3.0:1788658279.956328:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658279.956337:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002517b214 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025084160:12345-0@lo:400: 00000100:00100000:3.0:1788658279.956411:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002517b214 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025084160:12345-0@lo:400: Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658279.956429:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788658279.956596:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001951b1d4 x1875544025084160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658279.956613:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025084160:0@lo:400: 00000100:00100000:1.0:1788658279.956942:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025084288 00000100:00100000:1.0:1788658279.956948:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025084288 00000100:00100000:3.0:1788658279.957129:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658279.957138:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb7b7c8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025084288:12345-0@lo:400: 00000100:00100000:3.0:1788658279.957206:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb7b7c8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025084288:12345-0@lo:400: Request processed in 69us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658279.957212:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788658279.957346:0:7781:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000db9ce8e7 x1875544025084544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658279.957367:0:7781:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072fe3a38 going to sleep for 0 seconds 00000100:00100000:1.0:1788658279.957589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025084288:0@lo:400: 00000020:01000000:2.0:1788658279.957698:0:7778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658279.957729:0:7778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658279.957732:0:7778:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788658279.957737:0:7778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658279.957742:0:7778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658279.957744:0:7778:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658279.957748:0:7778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658279.957750:0:7778:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788658279.957780:0:7778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7778:1875544025084672:0@lo:502: 00000100:00100000:2.0:1788658279.957843:0:7778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.957937:0:7778:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf3cef26 going to sleep for 11 seconds 00000100:00100000:1.0:1788658279.958805:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a29c4ef2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025084416:0@lo:400: 00000100:00100000:1.0:1788658279.958864:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.960804:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025084416 00000100:00100000:2.0:1788658279.960827:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025084416 00000100:00100000:2.0:1788658279.960923:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658279.960933:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d5332ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025084416:12345-0@lo:400: 00000100:00100000:2.0:1788658279.961045:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d5332ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025084416:12345-0@lo:400: Request processed in 114us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658279.961052:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788658279.961165:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a29c4ef2 x1875544025084416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658279.961185:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a29c4ef2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025084416:0@lo:400: 00000100:00100000:3.0:1788658279.962565:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025084672 00000100:00100000:3.0:1788658279.962582:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025084672 00000100:00100000:3.0:1788658279.962651:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788658279.962662:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092d7f732 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:7778:x1875544025084672:12345-0@lo:502: 00000100:00100000:3.0:1788658279.962900:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092d7f732 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:7778:x1875544025084672:12345-0@lo:502: Request processed in 240us (5057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658279.962911:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788658279.962940:0:7778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:7778:1875544025084672:0@lo:502: 00000020:01000000:1.0:1788658279.962985:0:7778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658279.962994:0:7778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658279.962997:0:7778:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788658279.963002:0:7778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788658279.963210:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788658279.963238:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788658279.963248:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 00000000693de47a/0x48e67cc629c6e5b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658279.963261:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 00000000693de47a/0x48e67cc629c6e5b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658279.963272:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788658279.963274:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1eae393380 from 1 10000000:01000000:3.0:1788658279.963278:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788658279.963324:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 000000001495221e/0x48e67cc629c6e5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658279.963333:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 000000001495221e/0x48e67cc629c6e5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658279.963342:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 000000001495221e/0x48e67cc629c6e5dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658279.963375:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a29c4ef2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025084800:0@lo:101: 00000100:00100000:3.0:1788658279.963418:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658279.963457:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c420779 going to sleep for 11 seconds 00000100:00100000:1.0:1788658279.963663:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025084800 00000100:00100000:1.0:1788658279.963669:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025084800 00000100:00100000:3.0:1788658279.964224:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788658279.964235:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d1b32c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025084800:12345-0@lo:101: 00010000:00010000:3.0:1788658279.964251:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658279.964268:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c62b2613/0x48e67cc629c6e5e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e5dd expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658279.964298:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c62b2613/0x48e67cc629c6e5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e5dd expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658279.964311:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c62b2613/0x48e67cc629c6e5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e5dd expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658279.964321:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c62b2613, rc 0) 00000100:00100000:3.0:1788658279.964488:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d1b32c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025084800:12345-0@lo:101: Request processed in 256us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658279.964495:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658279.966309:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a29c4ef2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025084800:0@lo:101: 00010000:00010000:2.0:1788658279.966344:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 000000001495221e/0x48e67cc629c6e5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.966369:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 000000001495221e/0x48e67cc629c6e5dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658279.966484:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039f89017 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025084928:0@lo:501: 00000100:00100000:2.0:1788658279.967631:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.967828:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068d5df0d going to sleep for 11 seconds 00000100:00100000:0.0:1788658279.971658:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025084928 00000100:00100000:0.0:1788658279.971690:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025084928 00000100:00100000:1.0:1788658279.971836:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788658279.971849:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009166c74c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025084928:12345-0@lo:501: 00000100:00100000:1.0:1788658279.972049:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009166c74c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025084928:12345-0@lo:501: Request processed in 203us (4426us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658279.972059:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788658279.972255:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039f89017 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025084928:0@lo:501: 10000000:01000000:2.0:1788658279.972314:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788658279.972325:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: 000000001495221e/0x48e67cc629c6e5dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658279.972337:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: 000000001495221e/0x48e67cc629c6e5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788658279.974849:0:6541:0:(import.c:65:import_set_state_nolock()) 00000000ec2e9cf6 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658279.974983:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069b0ef7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875544025084032:12345-0@lo:38: Request processed in 19946us (20128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658279.975002:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788658279.975129:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788658279.975143:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788658279.975155:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788658279.975161:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788658279.975172:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000be18f82c lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788658279.975194:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000072fe3a38): req@00000000db9ce8e7 x1875544025084544/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658279.975223:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005de05aca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025084032:0@lo:38: 00000100:00100000:0.0:1788658279.975494:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025085056:0@lo:41: 00000100:00100000:0.0:1788658279.975549:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658279.975650:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025085056 00000100:00100000:3.0:1788658279.975658:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025085056 00000100:00100000:3.0:1788658279.975740:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658279.975750:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003616e909 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025085056:12345-0@lo:41: 00000004:00000024:3.0:1788658279.975787:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788658279.975834:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003616e909 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025085056:12345-0@lo:41: Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658279.975841:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658279.976122:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001f77814a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025085056:0@lo:41: 00000100:00100000:2.0:1788658279.976523:0:7781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.976557:0:7781:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072fe3a38 going to sleep for 11 seconds 00000100:00100000:3.0:1788658279.980052:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025084544 00000100:00100000:3.0:1788658279.980073:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025084544 00000100:00100000:3.0:1788658279.980221:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658279.980233:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039f89017 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7781:x1875544025084544:12345-0@lo:1000: 00000100:00100000:3.0:1788658279.980552:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039f89017 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7781:x1875544025084544:12345-0@lo:1000: Request processed in 322us (4030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658279.980562:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658279.984328:0:7781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db9ce8e7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025084544:0@lo:1000: 00000040:01000000:2.0:1788658279.984746:0:7781:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788658279.984821:0:7781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1335e0d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025085184:0@lo:1000: 00000100:00100000:2.0:1788658279.984932:0:7781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.985001:0:7781:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017eea5f5 going to sleep for 11 seconds 00000100:00100000:0.0:1788658279.986243:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025085184 00000100:00100000:0.0:1788658279.986261:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025085184 00000100:00100000:0.0:1788658279.986346:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658279.988132:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a2c9df1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7781:x1875544025085184:12345-0@lo:1000: 00000100:00100000:0.0:1788658279.988412:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a2c9df1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7781:x1875544025085184:12345-0@lo:1000: Request processed in 2056us (3481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658279.988423:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658279.989244:0:7781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1335e0d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025085184:0@lo:1000: 00000100:00100000:2.0:1788658279.989345:0:7781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1335e0d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025085312:0@lo:700: 00000100:00100000:2.0:1788658279.989411:0:7781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.989452:0:7781:0:(client.c:2716:ptlrpc_set_wait()) set 000000008ffe001b going to sleep for 11 seconds 00000100:00100000:0.0:1788658279.990212:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025085312 00000100:00100000:0.0:1788658279.990225:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025085312 00000100:00100000:0.0:1788658279.990294:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658279.990305:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b684a807 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7781:x1875544025085312:12345-0@lo:700: 00000100:00100000:0.0:1788658279.990396:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b684a807 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7781:x1875544025085312:12345-0@lo:700: Request processed in 93us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658279.990405:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658279.990729:0:7781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1335e0d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025085312:0@lo:700: 00000100:00100000:2.0:1788658279.991011:0:7781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1335e0d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025085440:0@lo:1000: 00000100:00100000:2.0:1788658279.991497:0:7781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.991673:0:7781:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ff5ad28 going to sleep for 11 seconds 00000100:00100000:3.0:1788658279.991742:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025085440 00000100:00100000:3.0:1788658279.991752:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025085440 00000100:00100000:3.0:1788658279.991813:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658279.991823:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cccb27fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7781:x1875544025085440:12345-0@lo:1000: 00000100:00100000:3.0:1788658279.991955:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cccb27fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7781:x1875544025085440:12345-0@lo:1000: Request processed in 134us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658279.991963:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658279.992131:0:7781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1335e0d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025085440:0@lo:1000: 00000004:00080000:2.0:1788658279.992199:0:7781:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000008ffe001b with version 0 00000020:00100000:2.0:1788658279.992220:0:7781:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788658279.992227:0:7781:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f1335e0d x1875544025085696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658279.992244:0:7781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1335e0d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025085696:0@lo:1000: 00000100:00100000:2.0:1788658279.992269:0:7781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658279.992295:0:7781:0:(client.c:2716:ptlrpc_set_wait()) set 0000000052eb6cef going to sleep for 11 seconds 00000100:00100000:3.0:1788658279.993187:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025085696 00000100:00100000:3.0:1788658279.993198:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025085696 00000100:00100000:3.0:1788658279.993254:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658279.993263:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066e0fea1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7781:x1875544025085696:12345-0@lo:1000: 00000001:00080000:2.0:1788658280.006122:0:7466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1788658280.006144:0:7466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788658280.006414:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066e0fea1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7781:x1875544025085696:12345-0@lo:1000: Request processed in 13145us (14137us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788658280.006431:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788658280.006473:0:7781:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788658280.006479:0:7781:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788658280.006504:0:7781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1335e0d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025085696:0@lo:1000: 00000100:00100000:2.0:1788658280.006635:0:7781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1335e0d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025085824:0@lo:1000: 00000100:00100000:2.0:1788658280.006730:0:7781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658280.006773:0:7781:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017eea5f5 going to sleep for 11 seconds 00000100:00100000:2.0:1788658280.006793:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025085824 00000100:00100000:2.0:1788658280.006803:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025085824 00000100:00100000:1.0:1788658280.007319:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658280.007330:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5626ae5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7781:x1875544025085824:12345-0@lo:1000: 00000100:00100000:1.0:1788658280.007419:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5626ae5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7781:x1875544025085824:12345-0@lo:1000: Request processed in 92us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658280.007426:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788658280.007698:0:7781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1335e0d pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7781:1875544025085824:0@lo:1000: 00000040:00080000:2.0:1788658280.007747:0:7781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788658280.007794:0:7781:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000008ffe001b with version 1 00000004:00080000:3.0:1788658280.007820:0:7779:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000af46c455 version 1 rpc_version 1 00000020:00100000:3.0:1788658280.007845:0:7779:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788658280.007853:0:7779:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001951b1d4 x1875544025086080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658280.007870:0:7779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7779:1875544025086080:0@lo:1000: 00000100:00100000:3.0:1788658280.007909:0:7779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658280.008029:0:7779:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c420779 going to sleep for 11 seconds 00000040:00080000:2.0:1788658280.015796:0:7781:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788658280.015932:0:7781:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1788658280.015939:0:7781:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1788658280.022657:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025086080 00000100:00100000:0.0:1788658280.022690:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025086080 00000100:00100000:0.0:1788658280.022785:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788658280.022795:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069df3d24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7779:x1875544025086080:12345-0@lo:1000: 00000001:00080000:3.0:1788658280.044090:0:7466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788658280.045925:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069df3d24 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7779:x1875544025086080:12345-0@lo:1000: Request processed in 23120us (38004us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788658280.045954:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1788658280.046266:0:7779:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788658280.046273:0:7779:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788658280.046298:0:7779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7779:1875544025086080:0@lo:1000: 00000020:00000004:2.0:1788658280.120254:0:7794:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658280.120563:0:7794:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788658280.903139:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658281.919061:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658282.433968:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff410a74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025086208:0@lo:41: 00000100:00100000:1.0:1788658282.434899:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658282.435897:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025086208 00000100:00100000:3.0:1788658282.435912:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025086208 00000100:00100000:3.0:1788658282.435980:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658282.435991:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005de05aca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025086208:12345-0@lo:41: 00000004:00000024:3.0:1788658282.436045:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788658282.436972:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005de05aca pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025086208:12345-0@lo:41: Request processed in 977us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658282.436986:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788658282.437522:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff410a74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025086208:0@lo:41: 00010000:00010000:1.0:1788658282.953732:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788658283.406245:0:7896:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658283.407965:0:7896:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788658283.967150:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788658284.434282:0:7944:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe45f401a0 20000000:00000080:0.0:1788658284.434301:0:7944:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1ebd935400 uarg=0000000000000000 20000000:01000000:0.0:1788658284.434352:0:7944:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788658284.434359:0:7944:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788658284.434364:0:7944:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788658284.434442:0:7944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788658284.434456:0:7944:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788658284.441595:0:7944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658284.442234:0:7944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788658284.442272:0:7944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788658284.442290:0:7944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788658284.442308:0:7944:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788658284.442327:0:7944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658284.442349:0:7944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000de114b54/0x48e67cc629c6e46a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e463 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658284.442355:0:7944:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000004c72d23/0x48e67cc629c6e558 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e551 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658284.442362:0:7944:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658284.442401:0:7944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000004c72d23/0x48e67cc629c6e558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e551 expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658284.442413:0:7944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000004c72d23/0x48e67cc629c6e558 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e551 expref: 17 pid: 6531 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658284.442436:0:7944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e3d0b2c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7944:1875544025086336:0@lo:104: 00000100:00100000:0.0:1788658284.442502:0:7944:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658284.442617:0:7944:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000de114b54/0x48e67cc629c6e46a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e463 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658284.442625:0:7944:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000de114b54/0x48e67cc629c6e46a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e463 expref: 17 pid: 6529 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658284.442641:0:7944:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ab9bf37 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7944:1875544025086464:0@lo:104: 00000100:00100000:0.0:1788658284.442660:0:7944:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bac4a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658284.447810:0:6519:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788658284.447873:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658284.448267:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025086336 00000100:00100000:1.0:1788658284.448276:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025086336 00000100:00100000:2.0:1788658284.448910:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025086464 00000100:00100000:2.0:1788658284.448917:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025086464 00000100:00100000:2.0:1788658284.448945:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658284.448954:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008188116b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:7944:x1875544025086336:12345-0@lo:104: 00010000:00010000:2.0:1788658284.448971:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658284.449118:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658284.449124:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008188116b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:7944:x1875544025086336:12345-0@lo:104: Request processed in 172us (6622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658284.449131:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788658284.449158:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658284.449165:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449174:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d6ad158d already unused, calling callback (00000000affb3be2) 10000000:00010000:3.0:1788658284.449178:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658284.449184:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658284.449193:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000499f34f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:7944:x1875544025086464:12345-0@lo:104: 00010000:00010000:2.0:1788658284.449201:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658284.449247:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658284.449252:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000499f34f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:7944:x1875544025086464:12345-0@lo:104: Request processed in 60us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658284.449258:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788658284.449317:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658284.449327:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658284.449333:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658284.449376:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449382:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658284.449399:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449405:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 00000000d6ad158d/0x48e67cc629c6e551 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e558 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449418:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658284.449420:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449424:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006cc9ca29 already unused, calling callback (00000000affb3be2) 10000000:00010000:3.0:1788658284.449426:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449431:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658284.449436:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658284.449448:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658284.449461:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449466:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658284.449484:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449489:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: 000000006cc9ca29/0x48e67cc629c6e463 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e46a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449503:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658284.449505:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658284.449506:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658284.449513:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658284.449527:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f59971 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025086720:0@lo:103: 00000100:00100000:3.0:1788658284.449568:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658284.449615:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025086720 00000100:00100000:3.0:1788658284.449619:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025086720 00010000:00010000:3.0:1788658284.449639:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000de114b54/0x48e67cc629c6e46a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e463 expref: 18 pid: 6529 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658284.449663:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658284.449669:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5dbab78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:3650:x1875544025086720:12345-0@lo:103: 00010000:00010000:3.0:1788658284.449679:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658284.449683:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000de114b54/0x48e67cc629c6e46a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e463 expref: 18 pid: 6529 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449692:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000de114b54/0x48e67cc629c6e46a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e463 expref: 18 pid: 6529 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658284.449738:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658284.449768:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5dbab78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:3650:x1875544025086720:12345-0@lo:103: Request processed in 100us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658284.449775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658284.449811:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f59971 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025086720:0@lo:103: 00000100:00100000:0.0:1788658284.449823:0:7944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e3d0b2c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7944:1875544025086336:0@lo:104: 00010000:00010000:0.0:1788658284.449836:0:7944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de114b54/0x48e67cc629c6e46a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e463 expref: 17 pid: 6529 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658284.449907:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658284.449918:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025086592:0@lo:103: 00000100:00100000:2.0:1788658284.449943:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658284.450043:0:7944:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ab9bf37 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7944:1875544025086464:0@lo:104: 00010000:00010000:0.0:1788658284.450065:0:7944:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450276:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658284.450293:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025086592 00000100:00100000:1.0:1788658284.450297:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025086592 00010000:00010000:1.0:1788658284.450314:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000004c72d23/0x48e67cc629c6e558 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e551 expref: 17 pid: 6531 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658284.450370:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658284.450377:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1335e0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3647:x1875544025086592:12345-0@lo:103: 00010000:00010000:1.0:1788658284.450385:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658284.450388:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000004c72d23/0x48e67cc629c6e558 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e551 expref: 17 pid: 6531 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450396:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000004c72d23/0x48e67cc629c6e558 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e551 expref: 17 pid: 6531 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450405:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000004c72d23/0x48e67cc629c6e558 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e551 expref: 17 pid: 6531 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450417:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450433:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450446:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450452:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450457:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450462:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450466:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e524fdc4 already unused, calling callback (00000000a732b953) 00010000:00010000:1.0:1788658284.450469:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450474:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450495:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658284.450504:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658284.450538:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1335e0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:3647:x1875544025086592:12345-0@lo:103: Request processed in 162us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658284.450544:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788658284.450589:0:7944:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658284.450596:0:7944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658284.450600:0:7944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e524fdc4/0x48e67cc629c6e5eb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658284.453309:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001951b1d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025086592:0@lo:103: 00000100:00100000:1.0:1788658284.991444:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025087232:0@lo:400: 00000100:00100000:1.0:1788658284.991538:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658284.991608:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788658284.991614:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b791664f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025086848:0@lo:400: 00000100:00100000:1.0:1788658284.991643:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658284.991663:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff410a74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025087360:0@lo:400: 00000100:00100000:1.0:1788658284.991692:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658284.992035:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025086848 00000100:00100000:3.0:1788658284.992044:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025086848 00000100:00100000:3.0:1788658284.992095:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788658284.992104:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1c21af8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:3649:x1875544025086848:12345-0@lo:400: 00010000:00010000:0.0:1788658284.992221:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658284.992251:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025087232 00000100:00100000:0.0:1788658284.992256:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025087232 00000100:00100000:0.0:1788658284.992290:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658284.992296:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000446ba2db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025087232:12345-0@lo:400: 00000100:00100000:3.0:1788658284.996678:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1c21af8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:3649:x1875544025086848:12345-0@lo:400: Request processed in 4566us (5025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658284.996695:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788658284.996858:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8e0bf7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025086976:0@lo:400: 00000100:00100000:3.0:1788658284.996905:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658284.996946:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000004f59971 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025087488:0@lo:41: 00000100:00100000:3.0:1788658284.996974:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658284.997000:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658284.997008:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cb783880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025087104:0@lo:400: 00000100:00100000:3.0:1788658284.997030:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658284.997064:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025087360 00000100:00100000:3.0:1788658284.997070:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025087360 00000100:00100000:3.0:1788658284.997103:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025087488 00000100:00100000:3.0:1788658284.997106:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025087488 00000100:00100000:3.0:1788658284.997115:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025087104 00000100:00100000:3.0:1788658284.997117:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025087104 00000100:00100000:3.0:1788658284.997131:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788658284.997138:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bef78e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025087360:12345-0@lo:400: 00000100:00100000:3.0:1788658284.997207:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bef78e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025087360:12345-0@lo:400: Request processed in 69us (5514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658284.997213:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788658284.997228:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788658284.997234:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4f0eef4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025087488:12345-0@lo:41: 00000004:00000024:3.0:1788658284.997259:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788658284.997293:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4f0eef4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025087488:12345-0@lo:41: Request processed in 60us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658284.997299:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788658284.997311:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658284.997317:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024a1dd09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025087104:12345-0@lo:400: 00000100:00100000:3.0:1788658284.997346:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024a1dd09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025087104:12345-0@lo:400: Request processed in 29us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658284.997352:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658284.997386:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cb783880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025087104:0@lo:400: 00000100:00100000:3.0:1788658284.997400:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000004f59971 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025087488:0@lo:41: 00000100:00100000:3.0:1788658284.997463:0:6538:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788658284.997471:0:6538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788658284.997579:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025086976 00000100:00100000:3.0:1788658284.997583:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025086976 00000100:00100000:3.0:1788658284.997606:0:6538:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788658284.997613:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658284.997619:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2d0f3ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025086976:12345-0@lo:400: 00000100:00100000:3.0:1788658284.997655:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2d0f3ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025086976:12345-0@lo:400: Request processed in 37us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658284.997661:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788658284.997700:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b8e0bf7a x1875544025086976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658284.997736:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8e0bf7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025086976:0@lo:400: 00000100:00100000:0.0:1788658285.000596:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000446ba2db pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025087232:12345-0@lo:400: Request processed in 8292us (9050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658285.000613:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658285.010355:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff410a74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025087360:0@lo:400: 00010000:00080000:1.0:1788658285.010380:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e0232182 x1875544025087232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658285.010391:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e0232182 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025087232:0@lo:400: 00000100:00100000:1.0:1788658285.010417:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b791664f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025086848:0@lo:400: 00010000:00010000:3.0:1788658286.014948:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658287.038972:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658287.552487:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025087616:0@lo:41: 00000100:00100000:3.0:1788658287.552567:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658287.552641:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025087616 00000100:00100000:3.0:1788658287.552648:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025087616 00000100:00100000:3.0:1788658287.552695:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658287.552727:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004f59971 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025087616:12345-0@lo:41: 00000004:00000024:3.0:1788658287.552767:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788658287.552817:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004f59971 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025087616:12345-0@lo:41: Request processed in 115us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658287.552824:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658287.552874:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf40b32b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025087616:0@lo:41: 10000000:01000000:2.0:1788658287.871107:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658287.871116:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ec11f4800 from 1 10000000:01000000:2.0:1788658287.871122:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658287.871182:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: 000000001736e257/0x48e67cc629c6e5f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658287.871195:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: 000000001736e257/0x48e67cc629c6e5f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658287.871206:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: 000000001736e257/0x48e67cc629c6e5f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658287.871247:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b2e1975 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025087744:0@lo:101: 00000100:00100000:2.0:1788658287.871807:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658287.871921:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039b05145 going to sleep for 11 seconds 00000100:00100000:0.0:1788658287.872112:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025087744 00000100:00100000:0.0:1788658287.872129:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025087744 00000100:00100000:0.0:1788658287.872484:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658287.872494:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb12f125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025087744:12345-0@lo:101: 00010000:00010000:0.0:1788658287.872509:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658287.872524:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009a45e88e/0x48e67cc629c6e5f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e5f2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658287.872548:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009a45e88e/0x48e67cc629c6e5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e5f2 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658287.872557:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009a45e88e/0x48e67cc629c6e5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e5f2 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658287.872565:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009a45e88e, rc 0) 00000100:00100000:0.0:1788658287.872619:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb12f125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025087744:12345-0@lo:101: Request processed in 128us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658287.872626:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788658287.872728:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b2e1975 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025087744:0@lo:101: 00010000:00010000:2.0:1788658287.872743:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: 000000001736e257/0x48e67cc629c6e5f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658287.872753:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: 000000001736e257/0x48e67cc629c6e5f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658287.872827:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b2e1975 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025087872:0@lo:501: 00000100:00100000:2.0:1788658287.872855:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658287.872994:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039b05145 going to sleep for 11 seconds 00000100:00100000:3.0:1788658287.873124:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025087872 00000100:00100000:3.0:1788658287.873129:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025087872 00000100:00100000:3.0:1788658287.873157:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788658287.873164:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2186a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025087872:12345-0@lo:501: 00000100:00100000:3.0:1788658287.873528:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2186a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025087872:12345-0@lo:501: Request processed in 365us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658287.873533:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788658287.873752:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b2e1975 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025087872:0@lo:501: 00000100:00100000:2.0:1788658287.873783:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008b2e1975 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025088000:0@lo:503: 00000100:00100000:2.0:1788658287.873828:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658287.873853:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039b05145 going to sleep for 11 seconds 00000100:00100000:3.0:1788658287.873960:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025088000 00000100:00100000:3.0:1788658287.873965:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025088000 00000100:00100000:3.0:1788658287.874004:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788658287.874011:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2dcf5c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025088000:12345-0@lo:503: 00000100:00100000:3.0:1788658287.874106:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2dcf5c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025088000:12345-0@lo:503: Request processed in 96us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658287.874113:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788658287.874588:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008b2e1975 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025088000:0@lo:503: 00000100:00100000:1.0:1788658287.875538:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e8b4b5c5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8112:1875544025088128:0@lo:502: 00000100:00100000:1.0:1788658287.875600:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658287.875674:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061c0fe1b going to sleep for 11 seconds 00000100:00100000:3.0:1788658287.875783:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025088128 00000100:00100000:3.0:1788658287.875790:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025088128 00000100:00100000:3.0:1788658287.875869:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788658287.875877:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008673b13d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:8112:x1875544025088128:12345-0@lo:502: 00000100:00100000:3.0:1788658287.876010:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008673b13d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:8112:x1875544025088128:12345-0@lo:502: Request processed in 133us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658287.876018:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788658287.876093:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e8b4b5c5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8112:1875544025088128:0@lo:502: 00000020:01000000:1.0:1788658287.876119:0:8112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658287.876129:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658287.876132:0:8112:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658287.876138:0:8112:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1ec11f4800 00000020:00000080:1.0:1788658287.876141:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788658287.876195:0:8112:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8112:1875544025088256:0@lo:502: 00000100:00100000:1.0:1788658287.876246:0:8112:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658287.876687:0:8112:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96180 going to sleep for 11 seconds 00000100:00100000:0.0:1788658287.876903:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025088256 00000100:00100000:0.0:1788658287.876910:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025088256 00000100:00100000:0.0:1788658287.876945:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788658287.876952:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:8112:x1875544025088256:12345-0@lo:502: 00000100:00100000:0.0:1788658287.877069:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:8112:x1875544025088256:12345-0@lo:502: Request processed in 117us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658287.877076:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788658287.877455:0:8112:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8112:1875544025088256:0@lo:502: 00000020:01000000:1.0:1788658287.877483:0:8112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658287.877491:0:8112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658287.877493:0:8112:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788658287.877497:0:8112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788658287.877670:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788658287.877699:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658287.877734:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391a00/0x48e67cc629c6e5f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658287.877757:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391a00/0x48e67cc629c6e5f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658287.877768:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658287.877771:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ec1212800 from 1 10000000:01000000:0.0:1788658287.877774:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658287.877803:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658287.877811:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658287.877820:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658287.877839:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025088384:0@lo:101: 00000100:00100000:0.0:1788658287.877876:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658287.878038:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658287.878080:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025088384 00000100:00100000:1.0:1788658287.878085:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025088384 00000100:00100000:1.0:1788658287.878112:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788658287.878120:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025088384:12345-0@lo:101: 00010000:00010000:1.0:1788658287.878134:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658287.878148:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d1200/0x48e67cc629c6e607 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e600 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658287.878171:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d1200/0x48e67cc629c6e607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e600 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658287.878194:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec21d1200/0x48e67cc629c6e607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e600 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658287.878203:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1200, rc 0) 00000100:00100000:1.0:1788658287.878258:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025088384:12345-0@lo:101: Request processed in 138us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658287.878273:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788658287.878568:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025088384:0@lo:101: 00010000:00010000:0.0:1788658287.878581:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658287.878592:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658287.878648:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025088512:0@lo:501: 00000100:00100000:0.0:1788658287.878674:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658287.878697:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658287.878783:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025088512 00000100:00100000:1.0:1788658287.878788:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025088512 00000100:00100000:1.0:1788658287.878807:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788658287.878813:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025088512:12345-0@lo:501: 00000100:00100000:1.0:1788658287.878971:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025088512:12345-0@lo:501: Request processed in 157us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658287.878995:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788658287.879472:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025088512:0@lo:501: 00000100:00100000:0.0:1788658287.879506:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025088640:0@lo:503: 00000100:00100000:0.0:1788658287.879550:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658287.879584:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658287.879631:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025088640 00000100:00100000:1.0:1788658287.879636:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025088640 00000100:00100000:1.0:1788658287.879669:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788658287.879676:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025088640:12345-0@lo:503: 00000100:00100000:1.0:1788658287.879793:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025088640:12345-0@lo:503: Request processed in 118us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658287.879800:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788658287.881052:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025088640:0@lo:503: 00000100:00100000:0.0:1788658287.881774:0:8113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8113:1875544025088768:0@lo:502: 00000100:00100000:0.0:1788658287.881841:0:8113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658287.881875:0:8113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead8f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658287.882020:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025088768 00000100:00100000:1.0:1788658287.882027:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025088768 00000100:00100000:1.0:1788658287.882064:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788658287.882073:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:8113:x1875544025088768:12345-0@lo:502: 00000100:00100000:1.0:1788658287.882198:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:8113:x1875544025088768:12345-0@lo:502: Request processed in 125us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658287.882205:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788658287.882534:0:8113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8113:1875544025088768:0@lo:502: 00000020:01000000:0.0:1788658287.882557:0:8113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658287.882567:0:8113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658287.882569:0:8113:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788658287.882575:0:8113:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1ec1212800 00000020:00000080:0.0:1788658287.882578:0:8113:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788658287.882601:0:8113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8113:1875544025088896:0@lo:502: 00000100:00100000:0.0:1788658287.882636:0:8113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658287.882665:0:8113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead8f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658287.882737:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025088896 00000100:00100000:1.0:1788658287.882742:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025088896 00000100:00100000:1.0:1788658287.882762:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788658287.882768:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:8113:x1875544025088896:12345-0@lo:502: 00000100:00100000:1.0:1788658287.882829:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:8113:x1875544025088896:12345-0@lo:502: Request processed in 60us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658287.882835:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788658287.884040:0:8113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8113:1875544025088896:0@lo:502: 00000020:01000000:0.0:1788658287.884075:0:8113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658287.884083:0:8113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658287.884085:0:8113:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788658287.884088:0:8113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788658287.884501:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788658287.884521:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658287.884531:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658287.884543:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658288.066495:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658289.087645:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658290.112024:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025089280:0@lo:400: 00000100:00100000:0.0:1788658290.112134:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658290.112225:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658290.112233:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025089408:0@lo:400: 00000100:00100000:0.0:1788658290.112275:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658290.112321:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025089280 00000100:00100000:0.0:1788658290.112331:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025089280 00000100:00100000:1.0:1788658290.112454:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025089024:0@lo:400: 00000100:00100000:1.0:1788658290.112498:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658290.112525:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025089536:0@lo:400: 00000100:00100000:1.0:1788658290.112558:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658290.112577:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658290.112582:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025089152:0@lo:400: 00000100:00100000:1.0:1788658290.112602:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658290.112627:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025089024 00000100:00100000:1.0:1788658290.112630:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025089024 00000100:00100000:1.0:1788658290.112673:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788658290.112683:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:3649:x1875544025089024:12345-0@lo:400: 00000100:00100000:1.0:1788658290.112768:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:3649:x1875544025089024:12345-0@lo:400: Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658290.112776:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788658290.113023:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025089536 00000100:00100000:3.0:1788658290.113028:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025089536 00000100:00100000:3.0:1788658290.113180:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658290.113189:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025089536:12345-0@lo:400: 00000100:00100000:0.0:1788658290.113264:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788658290.113273:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025089280:12345-0@lo:400: 00000100:00100000:1.0:1788658290.113328:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025089024:0@lo:400: 00000100:00100000:1.0:1788658290.113379:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025089408 00000100:00100000:1.0:1788658290.113382:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025089408 00000100:00100000:1.0:1788658290.113412:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025089152 00000100:00100000:1.0:1788658290.113414:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025089152 00000100:00100000:1.0:1788658290.113432:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658290.113438:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025089408:12345-0@lo:400: 00000100:00100000:2.0:1788658290.118209:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658290.118236:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025089152:12345-0@lo:400: 00010000:00010000:3.0:1788658290.118798:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658290.118897:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025089536:12345-0@lo:400: Request processed in 5705us (6333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658290.118909:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658290.118975:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025089664:0@lo:41: 00000100:00100000:3.0:1788658290.119046:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658290.119146:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025089536:0@lo:400: 00000100:00100000:3.0:1788658290.119182:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025089664 00000100:00100000:3.0:1788658290.119190:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025089664 00000100:00100000:3.0:1788658290.119231:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658290.119238:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025089664:12345-0@lo:41: 00000004:00000024:3.0:1788658290.119278:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788658290.119321:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025089664:12345-0@lo:41: Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658290.119328:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658290.119361:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025089664:0@lo:41: 00000100:00100000:0.0:1788658290.119906:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025089280:12345-0@lo:400: Request processed in 6631us (7769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658290.119916:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658290.120032:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025089280:0@lo:400: 00000100:00100000:1.0:1788658290.120176:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025089408:12345-0@lo:400: Request processed in 6735us (7896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658290.120187:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788658290.120812:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1e840c2d80 x1875544025089408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658290.120900:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025089408:0@lo:400: 00000100:00100000:2.0:1788658290.121881:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025089152:12345-0@lo:400: Request processed in 3652us (9272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658290.121896:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788658290.122060:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1e840c2680 x1875544025089152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658290.122085:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025089152:0@lo:400: 00010000:00010000:2.0:1788658291.136767:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658292.164296:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658292.678681:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025089792:0@lo:41: 00000100:00100000:2.0:1788658292.678779:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658292.679014:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025089792 00000100:00100000:3.0:1788658292.679024:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025089792 00000100:00100000:3.0:1788658292.679081:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788658292.679092:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025089792:12345-0@lo:41: 00000004:00000024:3.0:1788658292.679125:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788658292.679181:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025089792:12345-0@lo:41: Request processed in 90us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658292.679189:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788658292.679331:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025089792:0@lo:41: 00010000:00010000:3.0:1788658293.184784:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788658293.978984:0:8445:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788658293.978989:0:8445:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788658293.978991:0:8445:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788658293.979129:0:8445:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1ebd8b1800 00000020:01000004:2.0:1788658293.979151:0:8445:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788658293.979166:0:8445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788658293.979183:0:8445:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a1ebd880000) 00000020:00000080:2.0:1788658293.979205:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788658294.028460:0:8445:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788658294.028525:0:8445:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1788658294.060148:0:8445:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788658294.061932:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788658294.061958:0:8445:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788658294.061986:0:8445:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x48e67cc629c6e615 00000020:01000004:0.0:1788658294.061996:0:8445:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788658294.062028:0:8445:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788658294.062033:0:8445:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788658294.062043:0:8445:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788658294.062049:0:8445:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788658294.062070:0:8445:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a1eb23f0000) 00000020:00000080:0.0:1788658294.062089:0:8445:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1788658294.071410:0:8445:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658294.074958:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788658294.074973:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788658294.077271:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788658294.077287:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788658294.085797:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788658294.085825:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788658294.092063:0:8445:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658294.092369:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788658294.092381:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788658294.099751:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788658294.099770:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788658294.168939:0:8445:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658294.169785:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788658294.169799:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788658294.172644:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788658294.172660:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788658294.179009:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788658294.179105:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788658294.184895:0:8445:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658294.188102:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788658294.188122:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788658294.192608:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788658294.192633:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:0.0:1788658294.207936:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658294.323485:0:8445:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658294.324079:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788658294.324094:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788658294.327446:0:8445:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788658294.327467:0:8445:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788658294.328321:0:8445:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788658294.328356:0:8445:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788658294.328365:0:8445:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788658294.375439:0:8445:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788658294.375497:0:8445:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788658294.375502:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788658294.375504:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788658294.375505:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658294.375506:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658294.375508:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658294.375509:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658294.375510:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658294.375524:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658294.375526:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658294.375528:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658294.375530:0:8445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658294.375534:0:8445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788658294.375536:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658294.375538:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788658294.375539:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658294.375539:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658294.375540:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658294.375541:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658294.375542:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658294.375543:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788658294.375544:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788658294.375545:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658294.375546:0:8445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658294.375587:0:8445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788658294.375613:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025089920:0@lo:253: 00000100:00100000:0.0:1788658294.375748:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.377375:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025089920 00000100:00100000:2.0:1788658294.377398:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025089920 00000100:00100000:2.0:1788658294.377518:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788658294.377531:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:8445:x1875544025089920:12345-0@lo:253: 20000000:01000000:2.0:1788658294.377586:0:6529:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788658294.377592:0:6529:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788658294.377599:0:6529:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788658294.377604:0:6529:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788658294.377983:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658294.378220:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788658294.378260:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788658294.378312:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788658294.378325:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788658294.378350:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788658294.378382:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788658294.378537:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788658294.378561:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:2.0:1788658294.378564:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:2.0:1788658294.378587:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788658294.378596:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788658294.378620:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788658294.378629:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:2.0:1788658294.378656:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788658294.378670:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788658294.378695:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788658294.378759:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788658294.378881:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788658294.378899:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:2.0:1788658294.378902:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:2.0:1788658294.378921:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788658294.378930:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788658294.378979:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788658294.378987:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:2.0:1788658294.379001:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788658294.379006:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788658294.379018:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788658294.379033:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788658294.379399:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788658294.379410:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:2.0:1788658294.379412:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:2.0:1788658294.379425:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788658294.379430:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788658294.379457:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788658294.379462:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:2.0:1788658294.379474:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788658294.379480:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788658294.379491:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788658294.379506:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788658294.379519:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788658294.379522:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788658294.379526:0:6529:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788658294.379580:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788658294.379584:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 00000100:00100000:0.0:1788658294.379721:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3482b40 going to sleep for 11 seconds 20000000:01000000:0.0:1788658294.381289:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788658294.381353:0:8464:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788658294.381372:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1788658294.381844:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1788658294.381891:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1788658294.381921:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1788658294.381939:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788658294.381943:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788658294.383080:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788658294.383317:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788658294.383342:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788658294.383357:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788658294.383367:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788658294.383371:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788658294.384051:0:8466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788658294.384082:0:8466:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788658294.384096:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788658294.384284:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788658294.384328:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788658294.384373:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788658294.384396:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788658294.384400:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788658294.385260:0:8467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1788658294.385288:0:8467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1788658294.385304:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788658294.386135:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1788658294.386165:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1788658294.386180:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1788658294.386201:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788658294.386229:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.386266:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e4ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e4e8 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.386291:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e55f expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.386299:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e80031200/0x48e67cc629c6e59e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e597 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.386306:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d1000/0x48e67cc629c6e5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e5b3 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.386314:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e5dd expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.386323:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.386379:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e5dd expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.386398:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e5e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e5dd expref: 18 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.386429:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84431c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025090048:0@lo:104: 00000100:00100000:2.0:1788658294.386678:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658294.386870:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d1000/0x48e67cc629c6e5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e5b3 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.386880:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1ec21d1000/0x48e67cc629c6e5ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e5b3 expref: 18 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.386889:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025090176:0@lo:104: 00000100:00100000:2.0:1788658294.386924:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658294.387033:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e80031200/0x48e67cc629c6e59e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e597 expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.387043:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e80031200/0x48e67cc629c6e59e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e597 expref: 18 pid: 6529 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.387052:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025090304:0@lo:104: 00000100:00100000:2.0:1788658294.387075:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658294.387120:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025090048 00000100:00100000:1.0:1788658294.387129:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025090048 00000100:00100000:1.0:1788658294.387176:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025090176 00000100:00100000:1.0:1788658294.387179:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025090176 00000100:00100000:1.0:1788658294.387196:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658294.387207:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6529:x1875544025090048:12345-0@lo:104: 00010000:00010000:1.0:1788658294.387225:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387309:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658294.387316:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6529:x1875544025090048:12345-0@lo:104: Request processed in 111us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.387323:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658294.387342:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658294.387348:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6529:x1875544025090176:12345-0@lo:104: 00010000:00010000:1.0:1788658294.387356:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390a00/0x48e67cc629c6e5b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387396:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788658294.387401:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6529:x1875544025090176:12345-0@lo:104: Request processed in 54us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.387426:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788658294.387447:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658294.387454:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387461:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658294.387466:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e5dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387475:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658294.387483:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658294.387489:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658294.387539:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e5dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387546:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658294.387568:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e5dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387575:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e5dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5e4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387592:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658294.387595:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390a00/0x48e67cc629c6e5b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387610:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658294.387613:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390a00/0x48e67cc629c6e5b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387620:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390a00/0x48e67cc629c6e5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658294.387625:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390a00/0x48e67cc629c6e5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658294.387629:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658294.387643:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390a00/0x48e67cc629c6e5b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387648:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658294.387664:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390a00/0x48e67cc629c6e5b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387671:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390a00/0x48e67cc629c6e5b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5ba expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387680:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658294.387682:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658294.387684:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658294.387733:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025090432:0@lo:103: 00000100:00100000:1.0:1788658294.387765:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658294.387805:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025090560:0@lo:103: 00000100:00100000:1.0:1788658294.387824:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658294.387864:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025090432 00000100:00100000:1.0:1788658294.387868:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025090432 00010000:00010000:1.0:1788658294.387887:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e5e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e5dd expref: 19 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658294.387908:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025090560 00000100:00100000:1.0:1788658294.387911:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025090560 00010000:00010000:1.0:1788658294.387920:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d1000/0x48e67cc629c6e5ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e5b3 expref: 20 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658294.387932:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658294.387938:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:3648:x1875544025090432:12345-0@lo:103: 00010000:00010000:1.0:1788658294.387948:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658294.387954:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e5e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e5dd expref: 20 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387966:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e5e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e5dd expref: 20 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.387984:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658294.388011:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:3648:x1875544025090432:12345-0@lo:103: Request processed in 74us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.388017:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658294.388030:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658294.388035:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:3649:x1875544025090560:12345-0@lo:103: 00010000:00010000:1.0:1788658294.388043:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658294.388047:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d1000/0x48e67cc629c6e5ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e5b3 expref: 19 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.388056:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d1000/0x48e67cc629c6e5ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e5b3 expref: 19 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.388073:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658294.388098:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:3649:x1875544025090560:12345-0@lo:103: Request processed in 62us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.388104:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658294.388147:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025090560:0@lo:103: 00000100:00100000:1.0:1788658294.388173:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025090432:0@lo:103: 00010000:00010000:3.0:1788658294.388383:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658294.388810:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e55f expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.388821:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e566 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e55f expref: 18 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.388831:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025090688:0@lo:104: 00000100:00100000:2.0:1788658294.388880:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658294.388901:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e4e8 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.388908:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e4ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e4e8 expref: 18 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.388916:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025090816:0@lo:104: 00000100:00100000:2.0:1788658294.388936:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.388945:0:6529:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e98061240 going to sleep for 11 seconds 00010000:00010000:2.0:1788658294.388960:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e5e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e5dd expref: 18 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.388973:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84431c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025090048:0@lo:104: 00010000:00010000:2.0:1788658294.388993:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d1000/0x48e67cc629c6e5ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e5b3 expref: 17 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.389003:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025090176:0@lo:104: 00000100:00100000:1.0:1788658294.389179:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025090304 00000100:00100000:1.0:1788658294.389185:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025090304 00000100:00100000:1.0:1788658294.389214:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025090688 00000100:00100000:1.0:1788658294.389216:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025090688 00000100:00100000:1.0:1788658294.389226:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025090816 00000100:00100000:1.0:1788658294.389228:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025090816 00000100:00100000:1.0:1788658294.389252:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658294.389261:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:6529:x1875544025090304:12345-0@lo:104: 00010000:00010000:1.0:1788658294.389275:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391800/0x48e67cc629c6e597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.389335:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658294.389342:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:6529:x1875544025090304:12345-0@lo:104: Request processed in 83us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.389349:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658294.389363:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658294.389369:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6529:x1875544025090688:12345-0@lo:104: 00010000:00010000:1.0:1788658294.389376:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e55f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.389410:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788658294.389431:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6529:x1875544025090688:12345-0@lo:104: Request processed in 63us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.389438:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658294.389461:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658294.389472:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6529:x1875544025090816:12345-0@lo:104: 00010000:00010000:1.0:1788658294.389483:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045600/0x48e67cc629c6e4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.389691:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658294.389733:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391800/0x48e67cc629c6e597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.389744:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658294.389752:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391800/0x48e67cc629c6e597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.389766:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391800/0x48e67cc629c6e597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658294.389777:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391800/0x48e67cc629c6e597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658294.389785:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658294.389836:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391800/0x48e67cc629c6e597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.389846:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658294.389874:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391800/0x48e67cc629c6e597 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.389884:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391800/0x48e67cc629c6e597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e59e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.389905:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658294.389911:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e55f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.389917:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658294.389919:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e55f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.389943:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e55f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658294.389956:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e55f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658294.389964:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658294.389988:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e55f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.389998:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658294.390024:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e55f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.390036:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e55f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e566 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.390050:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658294.390054:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658294.390057:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658294.390268:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658294.390276:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6529:x1875544025090816:12345-0@lo:104: Request processed in 807us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.390283:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658294.390315:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025091072:0@lo:103: 00000100:00100000:1.0:1788658294.390353:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658294.390400:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025090944:0@lo:103: 00000100:00100000:1.0:1788658294.390422:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658294.390449:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025091072 00000100:00100000:1.0:1788658294.390457:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025091072 00010000:00010000:1.0:1788658294.390494:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e566 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e55f expref: 17 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658294.390688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025090944 00000100:00100000:1.0:1788658294.390696:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025090944 00010000:00010000:1.0:1788658294.390742:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e80031200/0x48e67cc629c6e59e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e597 expref: 18 pid: 6529 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658294.390757:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658294.390764:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:3647:x1875544025091072:12345-0@lo:103: 00010000:00010000:1.0:1788658294.390805:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658294.390818:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e566 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e55f expref: 18 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.390835:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e566 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e55f expref: 18 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.390859:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658294.390914:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:3647:x1875544025091072:12345-0@lo:103: Request processed in 150us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.390921:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658294.390934:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658294.390940:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3650:x1875544025090944:12345-0@lo:103: 00010000:00010000:1.0:1788658294.390947:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658294.390952:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e80031200/0x48e67cc629c6e59e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e597 expref: 17 pid: 6529 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.390962:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e80031200/0x48e67cc629c6e59e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e597 expref: 17 pid: 6529 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.390972:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658294.390998:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3650:x1875544025090944:12345-0@lo:103: Request processed in 59us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.391004:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658294.391039:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025091072:0@lo:103: 00000100:00100000:1.0:1788658294.391064:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025090944:0@lo:103: 00010000:00010000:2.0:1788658294.391343:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80031200/0x48e67cc629c6e59e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e597 expref: 16 pid: 6529 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.391362:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025090304:0@lo:104: 00010000:00010000:2.0:1788658294.391385:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e55f expref: 15 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.391403:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025090688:0@lo:104: 00000100:00100000:2.0:1788658294.391416:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025090816:0@lo:104: 00010000:00010000:2.0:1788658294.391445:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.393204:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658294.393222:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045600/0x48e67cc629c6e4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.393244:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045600 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658294.393249:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045600/0x48e67cc629c6e4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.393260:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045600/0x48e67cc629c6e4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658294.393288:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045600/0x48e67cc629c6e4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658294.393297:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658294.393483:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045600/0x48e67cc629c6e4e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.393492:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658294.393829:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045600/0x48e67cc629c6e4e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.393843:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045600/0x48e67cc629c6e4e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e4ef expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.393880:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658294.393884:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658294.393887:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658294.393954:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658294.393966:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658294.394002:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025091200:0@lo:103: 00000100:00100000:1.0:1788658294.394099:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658294.394180:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025091200 00000100:00100000:1.0:1788658294.394189:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025091200 00010000:00010000:1.0:1788658294.394228:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e4ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e4e8 expref: 15 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658294.394275:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658294.394284:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e8859e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:3647:x1875544025091200:12345-0@lo:103: 00010000:00010000:1.0:1788658294.394299:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658294.394305:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e4ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e4e8 expref: 15 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394318:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e4e8 expref: 15 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394335:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e4ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e4e8 expref: 15 pid: 6530 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394352:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394361:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394379:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394387:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394393:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394406:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394474:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658294.394481:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394492:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394512:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.394635:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658294.394674:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e8859e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:3647:x1875544025091200:12345-0@lo:103: Request processed in 391us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.394682:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658294.394784:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025091200:0@lo:103: 00010000:00010000:3.0:1788658294.396433:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.396454:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.396463:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e623 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788658294.396485:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788658294.401142:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:8445:x1875544025089920:12345-0@lo:253: Request processed in 23598us (25377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658294.401161:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788658294.404064:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025089920:0@lo:253: 10000000:01000000:0.0:1788658294.404091:0:8445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788658294.404094:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788658294.404096:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788658294.404098:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658294.404099:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788658294.404100:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658294.404102:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658294.404104:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658294.404106:0:8445:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788658294.404108:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658294.404110:0:8445:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788658294.404661:0:8445:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1ebd8b1800 from lustre-OST0000 10000000:01000000:2.0:1788658294.407990:0:8445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788658294.408002:0:8445:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788658294.408016:0:8445:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1eae393380 local copy 10000000:01000000:2.0:1788658294.408022:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788658294.408080:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.408096:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.408110:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.408168:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025091328:0@lo:101: 00000100:00100000:2.0:1788658294.408281:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.408339:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e98061240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658294.408581:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025091328 00000100:00100000:0.0:1788658294.408596:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025091328 00000100:00100000:0.0:1788658294.409110:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788658294.409122:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+13:8445:x1875544025091328:12345-0@lo:101: 00010000:00010000:0.0:1788658294.409141:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658294.409159:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e62a expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658294.409188:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e62a expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658294.409201:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e62a expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658294.409211:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031e00, rc 0) 00000100:00100000:0.0:1788658294.409291:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025091328:12345-0@lo:101: Request processed in 171us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658294.409312:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788658294.409399:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025091328:0@lo:101: 00010000:00010000:2.0:1788658294.409428:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.409438:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.409651:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025091456:0@lo:501: 00000100:00100000:2.0:1788658294.409743:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.411106:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e98061240 going to sleep for 11 seconds 00000100:00100000:1.0:1788658294.411179:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025091456 00000100:00100000:1.0:1788658294.411190:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025091456 00000100:00100000:1.0:1788658294.411252:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788658294.411263:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025091456:12345-0@lo:501: 00000100:00100000:1.0:1788658294.411487:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025091456:12345-0@lo:501: Request processed in 222us (1739us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658294.411501:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788658294.411885:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025091456:0@lo:501: 10000000:01000000:2.0:1788658294.411924:0:8445:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788658294.411980:0:8445:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788658294.411990:0:8445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.412002:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.412012:0:8445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.412041:0:8445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788658294.412097:0:8445:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1ebd8b1800 10000000:01000000:2.0:1788658294.412103:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788658294.412111:0:8445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788658294.412114:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658294.412119:0:8445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788658294.412122:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788658294.412160:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.412168:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.412178:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.412202:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025091584:0@lo:101: 00000100:00100000:2.0:1788658294.412258:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.412274:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eabe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658294.413146:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025091584 00000100:00100000:1.0:1788658294.413156:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025091584 00000100:00100000:1.0:1788658294.413193:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788658294.413214:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025091584:12345-0@lo:101: 00010000:00010000:1.0:1788658294.413230:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658294.413257:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e63f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e638 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.413293:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e638 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.413315:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e638 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.413331:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1c00, rc 0) 00000100:00100000:1.0:1788658294.413454:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025091584:12345-0@lo:101: Request processed in 238us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.413468:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788658294.413801:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025091584:0@lo:101: 00010000:00010000:2.0:1788658294.413822:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.413832:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.413947:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025091712:0@lo:501: 00000100:00100000:2.0:1788658294.413999:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.414033:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eabe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658294.414159:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025091712 00000100:00100000:1.0:1788658294.414163:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025091712 00000100:00100000:1.0:1788658294.414186:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788658294.414192:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025091712:12345-0@lo:501: 00000100:00100000:1.0:1788658294.414442:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025091712:12345-0@lo:501: Request processed in 250us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.414450:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00010000:3.0:1788658294.414951:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658294.414966:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.414978:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658294.414983:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.414994:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658294.415002:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658294.415009:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658294.415043:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.415050:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658294.415080:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.415087:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e62a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x48e67cc629c6e631 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.415105:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658294.415107:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658294.415108:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658294.415154:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658294.415171:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025091840:0@lo:103: 00000100:00100000:1.0:1788658294.415214:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658294.415367:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025091840 00000100:00100000:3.0:1788658294.415375:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025091840 00000100:00100000:3.0:1788658294.415432:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658294.415441:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:3650:x1875544025091840:12345-0@lo:103: 00010000:00010000:3.0:1788658294.415467:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658294.415483:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e62a expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.415503:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658294.415970:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:3650:x1875544025091840:12345-0@lo:103: Request processed in 525us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658294.415983:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658294.416125:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025091840:0@lo:103: 00000100:00100000:2.0:1788658294.417068:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025091712:0@lo:501: 00000100:00100000:2.0:1788658294.417162:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025091968:0@lo:503: 00000100:00100000:2.0:1788658294.417250:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.417359:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eabe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658294.418050:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025091968 00000100:00100000:0.0:1788658294.418061:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025091968 00000100:00100000:0.0:1788658294.418128:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788658294.418139:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025091968:12345-0@lo:503: 00000100:00100000:0.0:1788658294.418350:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025091968:12345-0@lo:503: Request processed in 208us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658294.418366:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788658294.418590:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025091968:0@lo:503: 00000040:00080000:2.0:1788658294.419134:0:8445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658294.419231:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092096:0@lo:502: 00000100:00100000:2.0:1788658294.419312:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.419378:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658294.419696:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025092096 00000100:00100000:1.0:1788658294.419738:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025092096 00000100:00100000:1.0:1788658294.419819:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788658294.419834:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025092096:12345-0@lo:502: 00000100:00100000:1.0:1788658294.419972:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025092096:12345-0@lo:502: Request processed in 144us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.419980:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788658294.420171:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092096:0@lo:502: 00000040:00080000:2.0:1788658294.420472:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788658294.420498:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788658294.420510:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788658294.420537:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788658294.420549:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788658294.420560:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788658294.420587:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092224:0@lo:502: 00000100:00100000:2.0:1788658294.420627:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.420658:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96300 going to sleep for 11 seconds 00000100:00100000:0.0:1788658294.420738:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025092224 00000100:00100000:0.0:1788658294.420744:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025092224 00000100:00100000:0.0:1788658294.420779:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788658294.420787:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025092224:12345-0@lo:502: 00000100:00100000:0.0:1788658294.420863:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025092224:12345-0@lo:502: Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658294.420870:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788658294.422164:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092224:0@lo:502: 00000040:00080000:2.0:1788658294.422291:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788658294.422306:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788658294.426198:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788658294.426215:0:8468:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788658294.426222:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658294.426225:0:8468:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788658294.426232:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658294.426265:0:8468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a1ebd883380) 00000020:00000080:2.0:1788658294.426316:0:8468:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788658294.426324:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788658294.426452:0:8468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1ebd8b1800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788658294.426463:0:8468:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658294.426472:0:8468:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x48e67cc629c6e64d 00010000:00010000:2.0:1788658294.434094:0:8468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788658294.435128:0:8468:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788658294.444012:0:8468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788658294.446874:0:8468:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788658294.465819:0:8468:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788658294.466338:0:8468:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788658294.486470:0:8468:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788658294.488429:0:8468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788658294.488446:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658294.488454:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658294.488457:0:8468:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788658294.488461:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658294.488466:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658294.488467:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788658294.488470:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788658294.488472:0:8468:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788658294.488502:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658294.488506:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658294.488507:0:8468:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788658294.488511:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788658294.495375:0:8445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788658294.496660:0:8445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788658294.496714:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.496729:0:8445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658294.497108:0:8445:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ebd8b1800 from 1 10000000:01000000:0.0:1788658294.497112:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658294.497247:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658294.497258:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658294.497273:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658294.497312:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092352:0@lo:101: 00000100:00100000:0.0:1788658294.497426:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658294.498683:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025092352 00000100:00100000:1.0:1788658294.498718:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025092352 00000100:00100000:1.0:1788658294.498784:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788658294.498795:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:8445:x1875544025092352:12345-0@lo:101: 00010000:00010000:1.0:1788658294.498813:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658294.498836:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c6e65b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e654 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.498869:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c6e65b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e654 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.498882:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c6e65b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e654 expref: 15 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.498898:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1e00, rc 0) 00000100:00100000:1.0:1788658294.498970:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025092352:12345-0@lo:101: Request processed in 176us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.498977:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788658294.499652:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3482a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658294.499690:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092352:0@lo:101: 00010000:00010000:0.0:1788658294.499726:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658294.499738:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658294.499897:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092480:0@lo:501: 00000100:00100000:0.0:1788658294.501275:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658294.501338:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3482a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658294.501797:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025092480 00000100:00100000:2.0:1788658294.501809:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025092480 00000100:00100000:2.0:1788658294.501867:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788658294.501877:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025092480:12345-0@lo:501: 00000100:00100000:2.0:1788658294.506885:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025092480:12345-0@lo:501: Request processed in 4996us (5603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658294.506905:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788658294.507304:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092480:0@lo:501: 00000100:00100000:0.0:1788658294.507398:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092608:0@lo:503: 00000100:00100000:0.0:1788658294.507507:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658294.507827:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3482a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658294.507951:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025092608 00000100:00100000:1.0:1788658294.507961:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025092608 00000100:00100000:1.0:1788658294.508037:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788658294.508047:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025092608:12345-0@lo:503: 00000100:00100000:1.0:1788658294.508391:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025092608:12345-0@lo:503: Request processed in 345us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.508399:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788658294.508496:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092608:0@lo:503: 00000040:00080000:0.0:1788658294.509046:0:8445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658294.509221:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092736:0@lo:502: 00000100:00100000:0.0:1788658294.509292:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658294.509411:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3482a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658294.510355:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025092736 00000100:00100000:2.0:1788658294.510371:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025092736 00000100:00100000:2.0:1788658294.510483:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788658294.510500:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025092736:12345-0@lo:502: 00000100:00100000:3.0:1788658294.516840:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025092736:12345-0@lo:502: Request processed in 6329us (7531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658294.516859:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788658294.517373:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092736:0@lo:502: 00000040:00080000:2.0:1788658294.517881:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788658294.517938:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788658294.518317:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092864:0@lo:502: 00000100:00100000:2.0:1788658294.518459:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658294.518807:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025092864 00000100:00100000:3.0:1788658294.518820:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025092864 00000100:00100000:3.0:1788658294.518906:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788658294.518921:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025092864:12345-0@lo:502: 00000100:00100000:2.0:1788658294.519251:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3453300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658294.519447:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025092864:12345-0@lo:502: Request processed in 528us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658294.519456:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788658294.519761:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092864:0@lo:502: 00000040:00080000:1.0:1788658294.519859:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788658294.519873:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788658294.521094:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658294.521108:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658294.521111:0:8472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658294.521118:0:8472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1ebd8b1800 00000020:00000080:1.0:1788658294.521121:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658294.521200:0:8472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658294.521205:0:8472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658294.521206:0:8472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788658294.521209:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788658294.521372:0:8445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788658294.521402:0:8445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658294.521478:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.521491:0:8445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658294.521676:0:8445:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788658294.521679:0:8445:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1ebd8b1800 10000000:01000000:2.0:1788658294.521683:0:8445:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1ebd8b1800 10000000:01000000:2.0:1788658294.521688:0:8445:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658294.521695:0:8445:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ebd8b1800 from 1 10000000:01000000:2.0:1788658294.521698:0:8445:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658294.522135:0:8445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.522739:0:8445:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.522753:0:8445:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.522785:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092992:0@lo:101: 00000100:00100000:2.0:1788658294.522876:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.522944:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a89600 going to sleep for 11 seconds 00000100:00100000:3.0:1788658294.523937:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025092992 00000100:00100000:3.0:1788658294.523955:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025092992 00000100:00100000:3.0:1788658294.525379:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788658294.525399:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8445:x1875544025092992:12345-0@lo:101: 00010000:00010000:3.0:1788658294.525423:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658294.525446:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81670a00/0x48e67cc629c6e669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e662 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.525483:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81670a00/0x48e67cc629c6e669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e662 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.525519:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81670a00/0x48e67cc629c6e669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e662 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.525530:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670a00, rc 0) 00000100:00100000:3.0:1788658294.525620:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025092992:12345-0@lo:101: Request processed in 228us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658294.525627:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788658294.526428:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025092992:0@lo:101: 00010000:00010000:2.0:1788658294.526472:0:8445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.526490:0:8445:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.526786:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025093120:0@lo:501: 00000100:00100000:2.0:1788658294.526873:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.526949:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a89600 going to sleep for 11 seconds 00000100:00100000:3.0:1788658294.527163:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025093120 00000100:00100000:3.0:1788658294.527172:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025093120 00000100:00100000:3.0:1788658294.527223:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788658294.527234:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025093120:12345-0@lo:501: 00000100:00100000:3.0:1788658294.527427:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025093120:12345-0@lo:501: Request processed in 190us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658294.527442:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788658294.527780:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025093120:0@lo:501: 00000100:00100000:2.0:1788658294.527820:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025093248:0@lo:503: 00000100:00100000:2.0:1788658294.527867:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.527888:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a89600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658294.528003:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025093248 00000100:00100000:0.0:1788658294.528008:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025093248 00000100:00100000:0.0:1788658294.528044:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788658294.528053:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025093248:12345-0@lo:503: 00000100:00100000:0.0:1788658294.528270:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025093248:12345-0@lo:503: Request processed in 217us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658294.528278:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788658294.529016:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025093248:0@lo:503: 00000040:00080000:2.0:1788658294.529401:0:8445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658294.529615:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025093376:0@lo:502: 00000100:00100000:2.0:1788658294.529777:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.529839:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a89600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658294.530301:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025093376 00000100:00100000:0.0:1788658294.530310:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025093376 00000100:00100000:0.0:1788658294.530358:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788658294.530367:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025093376:12345-0@lo:502: 00000100:00100000:0.0:1788658294.530511:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025093376:12345-0@lo:502: Request processed in 144us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658294.530534:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788658294.530847:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025093376:0@lo:502: 00000040:00080000:2.0:1788658294.531130:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788658294.531291:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788658294.531306:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788658294.531328:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788658294.531357:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788658294.531389:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788658294.531417:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788658294.531448:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788658294.531481:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788658294.531510:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788658294.531991:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788658294.532087:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788658294.532101:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788658294.532114:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788658294.532128:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788658294.532218:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788658294.532269:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788658294.532285:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788658294.532311:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788658294.532325:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788658294.532337:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788658294.532348:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788658294.532361:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788658294.532374:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788658294.532385:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788658294.532398:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788658294.532410:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788658294.532421:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788658294.532433:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788658294.532444:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788658294.532454:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788658294.532465:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788658294.532490:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788658294.532501:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788658294.532512:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788658294.533208:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788658294.533238:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788658294.533308:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025093504:0@lo:502: 00000100:00100000:2.0:1788658294.533409:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.533500:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a89600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658294.535264:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025093504 00000100:00100000:0.0:1788658294.535286:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025093504 00000100:00100000:0.0:1788658294.535438:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788658294.535450:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025093504:12345-0@lo:502: 00000100:00100000:0.0:1788658294.535875:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025093504:12345-0@lo:502: Request processed in 419us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658294.535893:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788658294.536081:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025093504:0@lo:502: 00000040:00080000:2.0:1788658294.536236:0:8445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788658294.536263:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788658294.538055:0:8473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788658294.538090:0:8473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a1d821bcd40) 00000020:00000080:3.0:1788658294.538123:0:8473:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788658294.538364:0:8473:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1ebd8b1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788658294.538369:0:8473:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1ebd8b1800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788658294.538372:0:8473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1ebd8b1800 3 00010000:00080000:3.0:1788658294.538409:0:8473:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d81ab8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658294.543388:0:8473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788658294.544219:0:8473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788658294.544288:0:8473:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788658294.544320:0:8473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x48e67cc629c6e677 00000100:00080000:3.0:1788658294.544334:0:8473:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658294.544342:0:8473:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1d81ab8000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658294.544391:0:8473:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eadba3100 x1875544025093632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658294.544427:0:8473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788658294.544515:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025093632:0@lo:38: 00000100:00100000:1.0:1788658294.544615:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658294.544687:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025093632 00000100:00100000:1.0:1788658294.544695:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025093632 00000100:00100000:1.0:1788658294.544753:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658294.544762:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875544025093632:12345-0@lo:38: 00010000:00080000:1.0:1788658294.544789:0:7958:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1788658294.544822:0:7958:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x48e67cc629c6e67e 00000004:00100000:1.0:1788658294.544838:0:7958:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788658294.544876:0:7958:0:(import.c:65:import_set_state_nolock()) ffff8a1ebd9af800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658294.544925:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875544025093632:12345-0@lo:38: Request processed in 162us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.544932:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788658294.544972:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1eadba3100 x1875544025093632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658294.544983:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658294.544992:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788658294.544999:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788658294.545004:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788658294.545006:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d81ab8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788658294.545013:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025093632:0@lo:38: 00000020:01000004:1.0:1788658294.545790:0:8473:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788658294.545810:0:8473:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a1eb22419c0) 00000020:00000080:1.0:1788658294.545831:0:8473:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788658294.545914:0:8473:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1ebd8b1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788658294.545919:0:8473:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1ebd8b1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788658294.545922:0:8473:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1ebd8b1800 3 00010000:00080000:1.0:1788658294.545956:0:8473:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d81aba800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.153@tcp at head 00000100:00100000:2.0:1788658294.548674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025093760:0@lo:400: 00000100:00100000:2.0:1788658294.548800:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.548853:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658294.548860:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025094144:0@lo:400: 00000100:00100000:2.0:1788658294.548888:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.548946:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025093888:0@lo:400: 00000100:00100000:2.0:1788658294.548972:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658294.549840:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025093760 00000100:00100000:3.0:1788658294.549856:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025093760 00000100:00100000:3.0:1788658294.549941:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658294.549955:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025093760:12345-0@lo:400: 00000100:00100000:2.0:1788658294.550696:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658294.550724:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025094016:0@lo:400: 00000100:00100000:2.0:1788658294.550794:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658294.550852:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025094144 00000100:00100000:2.0:1788658294.550859:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025094144 00000100:00100000:2.0:1788658294.550894:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025093888 00000100:00100000:2.0:1788658294.550897:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025093888 00000100:00100000:2.0:1788658294.550914:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658294.550922:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025094144:12345-0@lo:400: 00000100:00100000:2.0:1788658294.550973:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025094144:12345-0@lo:400: Request processed in 52us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658294.550981:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658294.551106:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025093760:12345-0@lo:400: Request processed in 1154us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658294.551115:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658294.551132:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025094016 00000100:00100000:3.0:1788658294.551135:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025094016 00000100:00100000:3.0:1788658294.551235:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658294.551251:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025094016:12345-0@lo:400: 00000100:00100000:3.0:1788658294.551287:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025094016:12345-0@lo:400: Request processed in 46us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658294.551292:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658294.552695:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788658294.552726:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025093888:12345-0@lo:400: 00000100:00100000:2.0:1788658294.552815:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025093888:12345-0@lo:400: Request processed in 95us (3841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658294.552821:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788658294.552898:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025094144:0@lo:400: 00010000:00080000:2.0:1788658294.552920:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d81b38000 x1875544025093760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658294.552932:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025093760:0@lo:400: 00010000:00080000:2.0:1788658294.552973:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d81b3b100 x1875544025094016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658294.552983:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025094016:0@lo:400: 00000100:00100000:2.0:1788658294.554116:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025093888:0@lo:400: 00010000:00010000:1.0:1788658294.557122:0:8473:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788658294.558689:0:8473:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788658294.559088:0:8473:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788658294.559115:0:8473:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x48e67cc629c6e68c 00000100:00080000:1.0:1788658294.559131:0:8473:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658294.559415:0:8473:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a1d81aba800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658294.559465:0:8473:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb9b100 x1875544025094272/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658294.559547:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875544025094272:0@lo:38: 00000100:00100000:2.0:1788658294.559664:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788658294.563312:0:8473:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788658294.563774:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025094272 00000100:00100000:2.0:1788658294.563794:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025094272 00000100:00100000:2.0:1788658294.563870:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658294.563885:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025094272:12345-0@lo:38: 00010000:00080000:2.0:1788658294.563938:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1788658294.563985:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x48e67cc629c6e693 00000004:00100000:2.0:1788658294.564005:0:6538:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788658294.564054:0:6538:0:(import.c:65:import_set_state_nolock()) ffff8a1d821a7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658294.564161:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875544025094272:12345-0@lo:38: Request processed in 278us (4499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658294.564170:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788658294.564228:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1ebdb9b100 x1875544025094272/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658294.564251:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658294.564263:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788658294.564273:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788658294.564279:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788658294.564281:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d81aba800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658294.564288:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875544025094272:0@lo:38: 00000040:00080000:1.0:1788658294.571436:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788658294.571612:0:8445:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788658294.571651:0:8445:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788658294.571672:0:8445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.571686:0:8445:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788658294.571786:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788658294.571790:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788658294.571791:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658294.571796:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658294.571798:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658294.571799:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658294.571800:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658294.571801:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788658294.571803:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788658294.571805:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658294.571806:0:8445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788658294.571811:0:8445:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788658294.571813:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788658294.571814:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788658294.571815:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658294.571816:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658294.571817:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658294.571818:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658294.571818:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658294.571819:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788658294.571820:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788658294.571821:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658294.571821:0:8445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788658294.571856:0:8445:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788658294.571883:0:8445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025094400:0@lo:253: 00000100:00100000:3.0:1788658294.572424:0:8445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658294.572507:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025094400 00000100:00100000:3.0:1788658294.572521:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025094400 00000100:00100000:3.0:1788658294.572744:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788658294.572757:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025094400:12345-0@lo:253: 20000000:01000000:3.0:1788658294.572803:0:6529:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788658294.572826:0:6529:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788658294.573373:0:8445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebdbd49c0 going to sleep for 11 seconds 20000000:01000000:1.0:1788658294.590153:0:6529:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788658294.590176:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788658294.590817:0:6552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788658294.590825:0:6552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788658294.590856:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.590892:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e589 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.590900:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e5ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e5a5 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.590908:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.590962:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e5ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e5a5 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.590979:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e5ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e5a5 expref: 16 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.591006:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025094528:0@lo:104: 00000100:00100000:2.0:1788658294.591097:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658294.591167:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e589 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.591177:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e589 expref: 16 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.591185:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025094656:0@lo:104: 00000100:00100000:2.0:1788658294.591207:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a89600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658294.591459:0:6519:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788658294.591481:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658294.591511:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025094528 00000100:00100000:1.0:1788658294.591545:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025094528 00000100:00100000:1.0:1788658294.591607:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025094656 00000100:00100000:1.0:1788658294.591613:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025094656 00000100:00100000:1.0:1788658294.591639:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658294.591655:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdae3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6552:x1875544025094528:12345-0@lo:104: 00010000:00010000:1.0:1788658294.591680:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6e5a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.591801:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658294.591812:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdae3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6552:x1875544025094528:12345-0@lo:104: Request processed in 160us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.591823:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658294.591893:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658294.591906:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6552:x1875544025094656:12345-0@lo:104: 00010000:00010000:1.0:1788658294.591922:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390c00/0x48e67cc629c6e589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.591981:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788658294.592221:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6552:x1875544025094656:12345-0@lo:104: Request processed in 86us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.592230:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788658294.592285:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658294.592293:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6e5a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592301:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670c00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658294.592306:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6e5a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592316:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6e5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658294.592324:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6e5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658294.592330:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658294.592369:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6e5a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592377:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658294.592396:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6e5a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592403:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6e5a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5ac expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592431:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658294.592435:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390c00/0x48e67cc629c6e589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592440:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390c00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658294.592443:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390c00/0x48e67cc629c6e589 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592451:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390c00/0x48e67cc629c6e589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658294.592456:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390c00/0x48e67cc629c6e589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658294.592461:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658294.592475:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390c00/0x48e67cc629c6e589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592480:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658294.592494:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390c00/0x48e67cc629c6e589 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592500:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390c00/0x48e67cc629c6e589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e590 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592513:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658294.592515:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658294.592516:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658294.592629:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658294.592655:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658294.592671:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025094912:0@lo:103: 00000100:00100000:1.0:1788658294.592735:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658294.592775:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025094912 00000100:00100000:1.0:1788658294.592780:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025094912 00010000:00010000:1.0:1788658294.592801:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e590 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e589 expref: 17 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658294.592825:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658294.592832:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3648:x1875544025094912:12345-0@lo:103: 00010000:00010000:1.0:1788658294.592843:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658294.592848:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e590 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e589 expref: 17 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592857:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e590 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e589 expref: 17 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658294.592876:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658294.592903:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3648:x1875544025094912:12345-0@lo:103: Request processed in 71us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658294.592909:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658294.592949:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025094912:0@lo:103: 00000100:00100000:2.0:1788658294.593225:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025094784:0@lo:103: 00000100:00100000:2.0:1788658294.593288:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658294.594108:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025094784 00000100:00100000:3.0:1788658294.594117:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025094784 00010000:00010000:3.0:1788658294.594152:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e5ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e5a5 expref: 17 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658294.594217:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658294.594263:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3650:x1875544025094784:12345-0@lo:103: 00010000:00010000:3.0:1788658294.594283:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658294.594293:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e5ac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e5a5 expref: 17 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.594309:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e5ac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e5a5 expref: 17 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.594337:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.594351:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788658294.594378:0:6523:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003877363s 00010000:00010000:3.0:1788658294.594385:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.594398:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.594408:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.594418:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.594426:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658294.594432:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.594446:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.594473:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658294.594490:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658294.595282:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3650:x1875544025094784:12345-0@lo:103: Request processed in 1035us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658294.595292:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658294.595522:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:8445:x1875544025094400:12345-0@lo:253: Request processed in 22767us (23523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658294.595554:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788658294.595620:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025094784:0@lo:103: 00010000:00010000:2.0:1788658294.595663:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e5ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e5a5 expref: 15 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.595679:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025094528:0@lo:104: 00010000:00010000:2.0:1788658294.595690:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e589 expref: 14 pid: 6531 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658294.595698:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025094656:0@lo:104: 00010000:00010000:2.0:1788658294.595748:0:6552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.595759:0:6552:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.595766:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658294.595772:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e69a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658294.597487:0:8445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8445:1875544025094400:0@lo:253: 10000000:01000000:3.0:1788658294.597513:0:8445:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788658294.597517:0:8445:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658294.597519:0:8445:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788658294.597520:0:8445:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658294.597521:0:8445:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658294.597522:0:8445:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658294.597523:0:8445:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658294.597525:0:8445:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658294.597526:0:8445:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788658294.597642:0:8445:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788658294.597645:0:8445:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658294.597647:0:8445:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788658294.597668:0:8445:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788658294.611675:0:8445:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788658294.611889:0:8445:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788658294.612159:0:8445:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788658294.612343:0:8445:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788658294.612531:0:8445:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788658294.612815:0:8445:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788658294.616922:0:8445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788658294.636344:0:8445:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788658294.636354:0:8445:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788658294.636407:0:8445:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788658294.638915:0:8445:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788658294.638957:0:8445:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788658294.638984:0:8445:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788658294.640380:0:8445:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658294.640844:0:8445:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788658295.230902:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658295.231694:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658295.231734:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025095040:0@lo:41: 00000100:00100000:3.0:1788658295.231820:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658295.231973:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025095040 00000100:00100000:0.0:1788658295.231981:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025095040 00000100:00100000:0.0:1788658295.232029:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658295.232038:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025095040:12345-0@lo:41: 00000004:00000024:0.0:1788658295.232074:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788658295.232147:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025095040:12345-0@lo:41: Request processed in 109us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658295.232155:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658295.232288:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025095040:0@lo:41: 00000020:00000004:1.0:1788658295.618133:0:8530:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658295.618448:0:8530:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788658296.261327:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788658297.023495:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788658297.023504:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ec11f4800 from 30 10000000:01000000:1.0:1788658297.023510:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788658297.023559:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.023602:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.023615:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658297.023641:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025095168:0@lo:101: 00000100:00100000:1.0:1788658297.023751:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.023913:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025095168 00000100:00100000:0.0:1788658297.023922:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025095168 00000100:00100000:1.0:1788658297.023974:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3453e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658297.028497:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788658297.028518:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:6534:x1875544025095168:12345-0@lo:101: 00010000:00010000:0.0:1788658297.028538:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658297.028562:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e80031a00/0x48e67cc629c6e6a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e6a1 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.029353:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e80031a00/0x48e67cc629c6e6a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e6a1 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.029367:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e80031a00/0x48e67cc629c6e6a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e6a1 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.029376:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031a00, rc 0) 00000100:00100000:0.0:1788658297.029450:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025095168:12345-0@lo:101: Request processed in 940us (5698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.029464:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788658297.034076:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025095168:0@lo:101: 00010000:00010000:0.0:1788658297.034108:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.034122:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658297.034215:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025095296:0@lo:501: 00000100:00100000:0.0:1788658297.034291:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.034333:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.034477:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025095296 00000100:00100000:2.0:1788658297.034484:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025095296 00000100:00100000:2.0:1788658297.034535:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788658297.034545:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025095296:12345-0@lo:501: 00000100:00100000:2.0:1788658297.034720:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025095296:12345-0@lo:501: Request processed in 158us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.034728:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788658297.036372:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025095296:0@lo:501: 00000100:00100000:0.0:1788658297.036423:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025095424:0@lo:503: 00000100:00100000:0.0:1788658297.036490:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.036522:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.037346:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025095424 00000100:00100000:2.0:1788658297.037354:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025095424 00000100:00100000:2.0:1788658297.037394:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788658297.037402:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025095424:12345-0@lo:503: 00000100:00100000:2.0:1788658297.037520:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025095424:12345-0@lo:503: Request processed in 118us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.037527:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788658297.038362:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025095424:0@lo:503: 00000100:00100000:0.0:1788658297.040297:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8599:1875544025095552:0@lo:502: 00000100:00100000:0.0:1788658297.040384:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.040430:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.040551:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025095552 00000100:00100000:2.0:1788658297.040559:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025095552 00000100:00100000:2.0:1788658297.040605:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788658297.040615:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8599:x1875544025095552:12345-0@lo:502: 00000100:00100000:2.0:1788658297.040773:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8599:x1875544025095552:12345-0@lo:502: Request processed in 159us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.040781:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788658297.041051:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8599:1875544025095552:0@lo:502: 00000100:00100000:0.0:1788658297.041103:0:8599:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8599:1875544025095680:0@lo:502: 00000100:00100000:0.0:1788658297.041138:0:8599:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.041168:0:8599:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.041729:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025095680 00000100:00100000:2.0:1788658297.041736:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025095680 00000100:00100000:2.0:1788658297.041767:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788658297.041775:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8599:x1875544025095680:12345-0@lo:502: 00000100:00100000:2.0:1788658297.041862:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:8599:x1875544025095680:12345-0@lo:502: Request processed in 88us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.041949:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788658297.042089:0:8599:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8599:1875544025095680:0@lo:502: 00000040:00080000:0.0:1788658297.042119:0:8599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788658297.042531:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788658297.042557:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788658297.042568:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.042731:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658297.042744:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788658297.042747:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ec11f4800 from 5 10000000:01000000:2.0:1788658297.042750:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658297.042782:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.042791:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.042801:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658297.042817:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025095808:0@lo:101: 00000100:00100000:2.0:1788658297.042858:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658297.043395:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a89840 going to sleep for 11 seconds 00000100:00100000:0.0:1788658297.043951:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025095808 00000100:00100000:0.0:1788658297.043958:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025095808 00000100:00100000:0.0:1788658297.044010:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788658297.044020:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025095808:12345-0@lo:101: 00010000:00010000:0.0:1788658297.044033:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658297.044048:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e80030400/0x48e67cc629c6e6b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e6af expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.044072:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e80030400/0x48e67cc629c6e6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e6af expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.044084:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e80030400/0x48e67cc629c6e6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e6af expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.044094:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80030400, rc 0) 00000100:00100000:0.0:1788658297.044146:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025095808:12345-0@lo:101: Request processed in 127us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.044152:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788658297.044195:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025095808:0@lo:101: 00010000:00010000:0.0:1788658297.044210:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.044220:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658297.044999:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025095936:0@lo:256: 00000100:00100000:0.0:1788658297.045041:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.045075:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb35616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658297.045090:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025095936 00000100:00100000:0.0:1788658297.045095:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025095936 00000100:00100000:0.0:1788658297.045122:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788658297.045128:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025095936:12345-0@lo:256: 20000000:01000000:0.0:1788658297.045144:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788658297.045158:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788658297.045162:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788658297.045228:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025095936:12345-0@lo:256: Request processed in 99us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.047329:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788658297.047427:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025095936:0@lo:256: 10000000:01000000:0.0:1788658297.047487:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788658297.047498:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.047510:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658297.047519:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788658297.047522:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788658297.047525:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788658297.047555:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.047565:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.047575:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658297.047607:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025096064:0@lo:101: 00000100:00100000:0.0:1788658297.049014:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.049054:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f24be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.049351:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025096064 00000100:00100000:2.0:1788658297.049359:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025096064 00000100:00100000:2.0:1788658297.049567:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788658297.050327:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025096064:12345-0@lo:101: 00010000:00010000:2.0:1788658297.050355:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658297.050379:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e6c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e6bd expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.050410:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e6bd expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.050422:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e6bd expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.050432:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390000, rc 0) 00000100:00100000:2.0:1788658297.051350:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025096064:12345-0@lo:101: Request processed in 1762us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.051359:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788658297.053141:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025096064:0@lo:101: 00010000:00010000:0.0:1788658297.053167:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.053179:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658297.053256:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025096192:0@lo:501: 00000100:00100000:0.0:1788658297.053317:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.053379:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f24be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.054061:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025096192 00000100:00100000:2.0:1788658297.054070:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025096192 00000100:00100000:2.0:1788658297.054122:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788658297.054133:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025096192:12345-0@lo:501: 00000100:00100000:2.0:1788658297.054305:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025096192:12345-0@lo:501: Request processed in 174us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.054313:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788658297.055005:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025096192:0@lo:501: 00000100:00100000:0.0:1788658297.055059:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025096320:0@lo:503: 00000100:00100000:0.0:1788658297.055117:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.055142:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f24be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.055841:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025096320 00000100:00100000:2.0:1788658297.055849:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025096320 00000100:00100000:2.0:1788658297.055900:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788658297.055909:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025096320:12345-0@lo:503: 00000100:00100000:2.0:1788658297.056033:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025096320:12345-0@lo:503: Request processed in 125us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.056040:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788658297.056215:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025096320:0@lo:503: 00000100:00100000:1.0:1788658297.057923:0:8601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8601:1875544025096448:0@lo:502: 00000100:00100000:1.0:1788658297.057985:0:8601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.058014:0:8601:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e859299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.058110:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025096448 00000100:00100000:2.0:1788658297.058116:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025096448 00000100:00100000:2.0:1788658297.058157:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788658297.058164:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:8601:x1875544025096448:12345-0@lo:502: 00000100:00100000:2.0:1788658297.058279:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:8601:x1875544025096448:12345-0@lo:502: Request processed in 115us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.058286:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788658297.058520:0:8601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8601:1875544025096448:0@lo:502: 00000020:01000000:1.0:1788658297.058545:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788658297.058552:0:8601:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788658297.058558:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658297.058560:0:8601:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788658297.058565:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788658297.058568:0:8601:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:1.0:1788658297.058600:0:8601:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788658297.058603:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658297.058616:0:8601:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a1eb2244d40) 00000020:00000080:1.0:1788658297.058643:0:8601:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788658297.058649:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788658297.058768:0:8601:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788658297.058774:0:8601:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788658297.058781:0:8601:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6e6d2 00010000:00080000:1.0:1788658297.058816:0:8601:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb5e64800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1788658297.061116:0:8601:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788658297.080556:0:8601:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788658297.080763:0:8601:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788658297.081522:0:8601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658297.082161:0:8601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658297.083793:0:8601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788658297.083963:0:8601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788658297.091211:0:8603:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658297.091221:0:8603:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788658297.099055:0:8601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788658297.099068:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788658297.099105:0:8601:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788658297.099125:0:8601:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6e6d9 00000100:00080000:1.0:1788658297.099133:0:8601:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658297.099138:0:8601:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a1eb5e64800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658297.099171:0:8601:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb98700 x1875544025096576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658297.099199:0:8601:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788658297.099274:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658297.099278:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658297.099280:0:8601:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000100:00100000:0.0:1788658297.099331:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025096704:0@lo:400: 00000100:00100000:3.0:1788658297.099395:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025096576:0@lo:8: 00000100:00100000:0.0:1788658297.099406:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788658297.099440:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658297.099446:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658297.099448:0:8601:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788658297.099451:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788658297.099453:0:8601:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788658297.099478:0:8601:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8601:1875544025097472:0@lo:502: 00000100:00100000:0.0:1788658297.100529:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025097216:0@lo:400: 00000100:00100000:0.0:1788658297.100581:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.100616:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788658297.100624:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025096832:0@lo:400: 00000100:00100000:0.0:1788658297.100662:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.100682:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025097344:0@lo:400: 00000100:00100000:0.0:1788658297.100723:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.100764:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025097088:0@lo:400: 00000100:00100000:0.0:1788658297.100789:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.100813:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658297.100818:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025096960:0@lo:400: 00000100:00100000:0.0:1788658297.100854:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.100895:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025096704 00000100:00100000:0.0:1788658297.100903:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025096704 00000100:00100000:0.0:1788658297.100943:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025097216 00000100:00100000:0.0:1788658297.100945:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025097216 00000100:00100000:0.0:1788658297.100971:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025097344 00000100:00100000:0.0:1788658297.100973:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025097344 00000100:00100000:0.0:1788658297.100987:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025096960 00000100:00100000:0.0:1788658297.100989:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025096960 00000100:00100000:0.0:1788658297.101003:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658297.101012:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025096704:12345-0@lo:400: 00000100:00100000:2.0:1788658297.101059:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788658297.101064:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025096704:12345-0@lo:400: Request processed in 53us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.101068:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025097216:12345-0@lo:400: 00000100:00100000:0.0:1788658297.101071:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658297.101088:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658297.101093:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025097344:12345-0@lo:400: 00000100:00100000:2.0:1788658297.101099:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025097216:12345-0@lo:400: Request processed in 35us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.101104:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658297.101116:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658297.101116:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025097344:12345-0@lo:400: Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.101122:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025096960:12345-0@lo:400: 00000100:00100000:0.0:1788658297.101122:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658297.101143:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025096832 00000100:00100000:0.0:1788658297.101147:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025096832 00000100:00100000:2.0:1788658297.101154:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025096960:12345-0@lo:400: Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.101159:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658297.101174:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025097088 00000100:00100000:0.0:1788658297.101177:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025097088 00000100:00100000:0.0:1788658297.101188:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788658297.101190:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1e840c1180 x1875544025096960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658297.101193:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025096832:12345-0@lo:400: 00000100:00100000:2.0:1788658297.101205:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025096960:0@lo:400: 00000100:00100000:0.0:1788658297.101224:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025096832:12345-0@lo:400: Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.101230:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658297.101242:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658297.101248:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025097088:12345-0@lo:400: 00000100:00100000:0.0:1788658297.101281:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025097088:12345-0@lo:400: Request processed in 33us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.101287:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658297.101317:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025097088:0@lo:400: 00000100:00100000:0.0:1788658297.101337:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025096832:0@lo:400: 00010000:00080000:0.0:1788658297.101360:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1e840c1f80 x1875544025097344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658297.101370:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025097344:0@lo:400: 00010000:00080000:0.0:1788658297.101380:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1e840c2300 x1875544025096704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658297.101387:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025096704:0@lo:400: 00010000:00080000:0.0:1788658297.101397:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1e840c1880 x1875544025097216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658297.101403:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025097216:0@lo:400: 00000100:00100000:1.0:1788658297.101699:0:8601:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.101751:0:8601:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bf300 going to sleep for 11 seconds 00000100:00080000:1.0:1788658297.101764:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658297.101774:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658297.101829:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025097472 00000100:00100000:0.0:1788658297.101839:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025097472 00000100:00100000:3.0:1788658297.101932:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.102016:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788658297.102023:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:8601:x1875544025097472:12345-0@lo:502: 00000100:00100000:0.0:1788658297.102149:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:8601:x1875544025097472:12345-0@lo:502: Request processed in 126us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.102157:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788658297.102223:0:8601:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8601:1875544025097472:0@lo:502: 00000020:01000000:3.0:1788658297.102261:0:8601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658297.102269:0:8601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658297.102272:0:8601:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788658297.102277:0:8601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1788658297.102388:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1788658297.102411:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788658297.102420:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.102431:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658297.102453:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788658297.102456:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ec1212800 from 30 10000000:01000000:2.0:1788658297.102459:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658297.102489:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.102497:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.102505:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658297.102520:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025097600:0@lo:101: 00000100:00100000:2.0:1788658297.102549:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658297.104431:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead888e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658297.104508:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025097600 00000100:00100000:1.0:1788658297.104517:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025097600 00000100:00100000:1.0:1788658297.104565:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788658297.104574:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025097600:12345-0@lo:101: 00010000:00010000:1.0:1788658297.104589:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658297.104608:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e6e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e6e0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.104635:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e6e0 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.104647:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e6e0 expref: 18 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.104656:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d0a00, rc 0) 00000100:00100000:1.0:1788658297.104730:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025097600:12345-0@lo:101: Request processed in 158us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658297.104737:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788658297.104956:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025096576 00000100:00100000:0.0:1788658297.104962:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025096576 00000100:00100000:0.0:1788658297.105036:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658297.105044:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875544025096576:12345-0@lo:8: 00010000:00080000:0.0:1788658297.105075:0:8452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:0.0:1788658297.105109:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6e6ee 00002000:00100000:0.0:1788658297.105148:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a1ebdea3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788658297.105153:0:8452:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788658297.105159:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788658297.105238:0:8452:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788658297.105817:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788658297.105846:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdea5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658297.105954:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875544025096576:12345-0@lo:8: Request processed in 908us (4020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.105962:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788658297.106045:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb98700 x1875544025096576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658297.106057:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658297.106067:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788658297.106076:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788658297.106081:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788658297.106084:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb5e64800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788658297.106140:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788658297.106146:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025096576:0@lo:8: 00000100:00100000:0.0:1788658297.106220:0:8604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1875544025097728:0@lo:700: 00000004:00080000:3.0:1788658297.106231:0:8603:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788658297.106259:0:8604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.106315:0:8604:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f24b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658297.106364:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025097728 00000004:00080000:3.0:1788658297.106372:0:8603:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 214322668428ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788658297.106376:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025097728 00080000:00080000:3.0:1788658297.106378:0:8603:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788658297.106673:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658297.106682:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8604:x1875544025097728:12345-0@lo:700: 00000100:00100000:1.0:1788658297.106794:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8460:1875544025097856:0@lo:700: 00000100:00100000:1.0:1788658297.106827:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.106855:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfd80 going to sleep for 11 seconds 00000100:00080000:0.0:1788658297.106930:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658297.106958:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025097856 00000100:00100000:3.0:1788658297.106963:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025097856 00000100:00100000:3.0:1788658297.106989:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658297.106996:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8460:x1875544025097856:12345-0@lo:700: 00000004:00080000:0.0:1788658297.108273:0:7466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788658297.108968:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025097600:0@lo:101: 00010000:00010000:3.0:1788658297.108989:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658297.109001:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658297.109075:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025097984:0@lo:501: 00000100:00100000:3.0:1788658297.109120:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658297.109158:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e91ca0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658297.109195:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025097984 00000100:00100000:0.0:1788658297.109213:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025097984 00000100:00100000:0.0:1788658297.109252:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788658297.109259:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025097984:12345-0@lo:501: 00000100:00100000:0.0:1788658297.109381:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025097984:12345-0@lo:501: Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.109388:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788658297.109662:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025097984:0@lo:501: 00000100:00100000:3.0:1788658297.109692:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025098112:0@lo:503: 00000100:00100000:3.0:1788658297.109750:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658297.109770:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e91ca0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658297.109961:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025098112 00000100:00100000:0.0:1788658297.109966:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025098112 00000100:00100000:0.0:1788658297.109990:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788658297.109996:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025098112:12345-0@lo:503: 00000100:00100000:0.0:1788658297.110083:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025098112:12345-0@lo:503: Request processed in 87us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.110089:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788658297.110160:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025098112:0@lo:503: 00000100:00100000:0.0:1788658297.110850:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8606:1875544025098240:0@lo:502: 00000100:00100000:0.0:1788658297.110903:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.110927:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb21690c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658297.111016:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025098240 00000100:00100000:3.0:1788658297.111026:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025098240 00000100:00100000:3.0:1788658297.111056:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788658297.111062:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:8606:x1875544025098240:12345-0@lo:502: 00000100:00100000:3.0:1788658297.111137:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:8606:x1875544025098240:12345-0@lo:502: Request processed in 75us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658297.111143:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788658297.111380:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8606:1875544025098240:0@lo:502: 00000100:00100000:0.0:1788658297.111417:0:8606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8606:1875544025098368:0@lo:502: 00000100:00100000:0.0:1788658297.111444:0:8606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.111675:0:8606:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658297.114439:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025098368 00000100:00100000:3.0:1788658297.114453:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025098368 00000100:00100000:0.0:1788658297.115798:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788658297.115811:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:8606:x1875544025098368:12345-0@lo:502: 00000100:00100000:0.0:1788658297.116005:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:8606:x1875544025098368:12345-0@lo:502: Request processed in 196us (4559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.116012:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788658297.116032:0:8606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8606:1875544025098368:0@lo:502: 00000040:00080000:1.0:1788658297.116070:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788658297.116264:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788658297.116288:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788658297.116571:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.116583:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658297.116613:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788658297.116615:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ec1212800 from 5 10000000:01000000:0.0:1788658297.116617:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788658297.116648:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.116654:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658297.116661:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658297.116676:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025098496:0@lo:101: 00000100:00100000:0.0:1788658297.116736:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.116776:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2156840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658297.116884:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025098496 00000100:00100000:1.0:1788658297.116890:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025098496 00000100:00100000:1.0:1788658297.116919:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788658297.116924:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025098496:12345-0@lo:101: 00010000:00010000:1.0:1788658297.116933:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658297.116943:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e6fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e6f5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.116960:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e6f5 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.116968:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e6f5 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.116973:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1a00, rc 0) 00000100:00100000:1.0:1788658297.117004:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025098496:12345-0@lo:101: Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658297.117010:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788658297.117030:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025098496:0@lo:101: 00010000:00010000:2.0:1788658297.117046:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.117054:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658297.117105:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025098624:0@lo:256: 00000100:00100000:2.0:1788658297.117138:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.117152:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025098624 00000100:00100000:2.0:1788658297.117155:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead888600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658297.117156:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025098624 00000100:00100000:0.0:1788658297.117179:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788658297.117186:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025098624:12345-0@lo:256: 20000000:01000000:0.0:1788658297.117199:0:6530:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788658297.117214:0:6530:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788658297.117216:0:6530:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 40000000:02000000:2.0:1788658297.117535:0:6543:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1788658297.117610:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025098624:12345-0@lo:256: Request processed in 424us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.117633:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1788658297.122484:0:8460:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb98700 x1875544025097856/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788658313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658297.122505:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8460:1875544025097856:0@lo:700: 40000000:02000000:0.0:1788658297.122519:0:8460:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:2.0:1788658297.122583:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8460:x1875544025097856:12345-0@lo:700: Request processed in 15585us (15753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.122601:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658297.123759:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025098624:0@lo:256: 10000000:01000000:1.0:1788658297.123828:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658297.123845:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.123857:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658297.123867:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788658297.123869:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788658297.123873:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788658297.123908:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.123916:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.123925:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658297.123945:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025098752:0@lo:101: 00000100:00100000:1.0:1788658297.123995:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.124031:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.124698:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025098752 00000100:00100000:2.0:1788658297.124727:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025098752 00000100:00100000:2.0:1788658297.124778:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788658297.124789:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025098752:12345-0@lo:101: 00010000:00010000:2.0:1788658297.124803:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658297.124817:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e70a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e703 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.124844:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e703 expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.124855:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e703 expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.124863:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391600, rc 0) 00000100:00100000:2.0:1788658297.124905:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025098752:12345-0@lo:101: Request processed in 117us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.124912:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788658297.125089:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025098752:0@lo:101: 00010000:00010000:1.0:1788658297.125103:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.125112:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658297.125176:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025098880:0@lo:501: 00000100:00100000:1.0:1788658297.125218:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.125239:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658297.125253:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025098880 00000100:00100000:1.0:1788658297.125257:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025098880 00000100:00100000:1.0:1788658297.125282:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788658297.125289:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025098880:12345-0@lo:501: 00000100:00100000:1.0:1788658297.125419:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025098880:12345-0@lo:501: Request processed in 129us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658297.125427:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788658297.125905:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025098880:0@lo:501: 00000100:00100000:1.0:1788658297.125938:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025099008:0@lo:503: 00000100:00100000:1.0:1788658297.125978:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.125994:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658297.126006:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025099008 00000100:00100000:1.0:1788658297.126010:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025099008 00000100:00100000:1.0:1788658297.130012:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788658297.130033:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025099008:12345-0@lo:503: 00000100:00100000:1.0:1788658297.130200:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025099008:12345-0@lo:503: Request processed in 173us (4220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658297.130209:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788658297.130275:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025099008:0@lo:503: 00000001:00100000:0.0:1788658297.130727:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788658297.130846:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8604:x1875544025097728:12345-0@lo:700: Request processed in 24166us (24585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.130862:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788658297.130991:0:8604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb377f480 x1875544025097728/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788658313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658297.131004:0:8604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1875544025097728:0@lo:700: 00000100:00100000:0.0:1788658297.131556:0:8607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8607:1875544025099136:0@lo:502: 00000100:00100000:0.0:1788658297.131612:0:8607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.131774:0:8607:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e88579840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658297.132788:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025099136 00000100:00100000:3.0:1788658297.132797:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025099136 00000100:00100000:3.0:1788658297.132905:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788658297.132915:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:8607:x1875544025099136:12345-0@lo:502: 00000100:00100000:3.0:1788658297.133051:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:8607:x1875544025099136:12345-0@lo:502: Request processed in 137us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658297.133058:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788658297.134152:0:8607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8607:1875544025099136:0@lo:502: 00000020:01000000:3.0:1788658297.134189:0:8607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788658297.134196:0:8607:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788658297.134217:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658297.134220:0:8607:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788658297.134226:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788658297.134230:0:8607:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:3.0:1788658297.135464:0:8607:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788658297.135470:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658297.135493:0:8607:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a1d821b8000) 00000020:00000080:3.0:1788658297.135516:0:8607:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788658297.135523:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788658297.136735:0:8607:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788658297.136744:0:8607:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788658297.136753:0:8607:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6e718 00010000:00080000:3.0:1788658297.136789:0:8607:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d8230a800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.153@tcp at head 00000100:00100000:3.0:1788658297.140058:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025099264:0@lo:13: 00000100:00100000:3.0:1788658297.140124:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788658297.140176:0:8604:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788658297.140193:0:8604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1875544025099392:0@lo:7: 00000100:00100000:3.0:1788658297.140229:0:8604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658297.140252:0:8604:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e88579840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658297.140829:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025099392 00000100:00100000:1.0:1788658297.140838:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025099392 00000100:00100000:1.0:1788658297.140901:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658297.140911:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8604:x1875544025099392:12345-0@lo:7: 00000100:00100000:2.0:1788658297.141408:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025099264 00000100:00100000:2.0:1788658297.141414:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025099264 00000100:00100000:2.0:1788658297.141443:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658297.141451:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875544025099264:12345-0@lo:13: 00002000:00000024:2.0:1788658297.141470:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:2.0:1788658297.141535:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875544025099264:12345-0@lo:13: Request processed in 85us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.141542:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788658297.141666:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eadba1180 x1875544025099264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658297.141694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025099264:0@lo:13: 00010000:00010000:0.0:1788658297.141860:0:8607:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00002000:00080000:1.0:1788658297.148304:0:8454:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788658297.148318:0:8454:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788658297.148435:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8604:x1875544025099392:12345-0@lo:7: Request processed in 7522us (8200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658297.148448:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788658297.148519:0:8604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eadba2d80 x1875544025099392/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788658313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658297.148535:0:8604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1875544025099392:0@lo:7: 00000004:00080000:1.0:1788658297.148549:0:8604:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788658297.149721:0:8604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1875544025099520:0@lo:5: 00000100:00100000:1.0:1788658297.149781:0:8604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.149825:0:8604:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658297.150012:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025099520 00000100:00100000:3.0:1788658297.150022:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025099520 00000100:00100000:3.0:1788658297.150079:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658297.150087:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8604:x1875544025099520:12345-0@lo:5: 00002000:00080000:3.0:1788658297.150115:0:8452:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788658297.150158:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8604:x1875544025099520:12345-0@lo:5: Request processed in 71us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658297.150164:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788658297.152835:0:8604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb99500 x1875544025099520/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658297.152855:0:8604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1875544025099520:0@lo:5: 00000004:00080000:1.0:1788658297.152871:0:8604:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788658297.152918:0:8604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1875544025099648:0@lo:5: 00000100:00100000:1.0:1788658297.152971:0:8604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.153013:0:8604:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.153099:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025099648 00000100:00100000:2.0:1788658297.153106:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025099648 00000100:00100000:2.0:1788658297.153154:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658297.153163:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8604:x1875544025099648:12345-0@lo:5: 00002000:00080000:2.0:1788658297.153277:0:8454:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000040:01000000:0.0:1788658297.155377:0:8607:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788658297.155399:0:8607:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788658297.155551:0:8607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658297.155950:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8604:x1875544025099648:12345-0@lo:5: Request processed in 2783us (2974us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788658297.155959:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788658297.155976:0:8604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb99500 x1875544025099648/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658297.155994:0:8604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8604:1875544025099648:0@lo:5: 00000004:00080000:1.0:1788658297.156019:0:8604:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788658297.156057:0:8604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8604:1875544025099776:0@lo:900: 00000100:00100000:1.0:1788658297.156093:0:8604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.156138:0:8604:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfd80 going to sleep for 11 seconds 00000040:00080000:0.0:1788658297.156193:0:8607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658297.156382:0:8607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788658297.156476:0:8607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:2.0:1788658297.156575:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025099776 00000100:00100000:2.0:1788658297.156652:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025099776 00000100:00100000:2.0:1788658297.156731:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658297.156740:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8604:x1875544025099776:12345-0@lo:900: 00000100:00100000:2.0:1788658297.156804:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8604:x1875544025099776:12345-0@lo:900: Request processed in 66us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.156811:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788658297.156857:0:8604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb99880 x1875544025099776/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788658313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658297.156867:0:8604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8604:1875544025099776:0@lo:900: 00000040:00080000:0.0:1788658297.157094:0:8611:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658297.157098:0:8611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788658297.157922:0:8607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788658297.157942:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788658297.157982:0:8607:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788658297.158006:0:8607:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6e71f 00000100:00080000:2.0:1788658297.158013:0:8607:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658297.158018:0:8607:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1d8230a800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658297.158047:0:8607:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d81b3a680 x1875544025099904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658297.158073:0:8607:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788658297.158143:0:8607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658297.158152:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658297.158154:0:8607:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788658297.158157:0:8607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658297.158161:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658297.158163:0:8607:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658297.158166:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658297.158168:0:8607:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788658297.158193:0:8607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8607:1875544025100032:0@lo:502: 00000100:00100000:2.0:1788658297.158433:0:8607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658297.158464:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025100032 00000100:00100000:2.0:1788658297.158469:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025100032 00000100:00100000:2.0:1788658297.158506:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788658297.158514:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:8607:x1875544025100032:12345-0@lo:502: 00000100:00100000:3.0:1788658297.158734:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025099904:0@lo:8: 00000100:00100000:3.0:1788658297.158773:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658297.158819:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025099904 00000100:00100000:3.0:1788658297.158823:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025099904 00000100:00100000:3.0:1788658297.158844:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658297.158849:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875544025099904:12345-0@lo:8: 00000100:00100000:2.0:1788658297.158909:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:8607:x1875544025100032:12345-0@lo:502: Request processed in 395us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.158916:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:3.0:1788658297.158945:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000100:00100000:2.0:1788658297.158963:0:8607:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e87dad3c0 going to sleep for 11 seconds 00000020:00000080:3.0:1788658297.158982:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6e726 00000100:00100000:2.0:1788658297.158982:0:8607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:8607:1875544025100032:0@lo:502: 00002000:00100000:3.0:1788658297.158997:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a1d82309800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788658297.159002:0:8453:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788658297.159005:0:8453:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:01000000:2.0:1788658297.159008:0:8607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658297.159012:0:8607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658297.159014:0:8607:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788658297.159018:0:8607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00002000:00080000:3.0:1788658297.159074:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788658297.159100:0:8453:0:(import.c:65:import_set_state_nolock()) ffff8a1d8230f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658297.159137:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875544025099904:12345-0@lo:8: Request processed in 286us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658297.159144:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788658297.159169:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b3a680 x1875544025099904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658297.159179:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788658297.159186:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788658297.159193:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788658297.159197:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788658297.159199:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d8230a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788658297.159215:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788658297.159219:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025099904:0@lo:8: 00000020:01000000:1.0:1788658297.160808:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788658297.160845:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788658297.160856:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.160869:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658297.160880:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788658297.160883:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1eae393380 from 1 10000000:01000000:1.0:1788658297.160886:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788658297.160924:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.160934:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.160944:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658297.160966:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025100160:0@lo:101: 00000100:00100000:1.0:1788658297.161028:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.161076:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.161211:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025100160 00000100:00100000:2.0:1788658297.161220:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025100160 00000100:00100000:2.0:1788658297.161277:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788658297.161286:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025100160:12345-0@lo:101: 00010000:00010000:2.0:1788658297.161299:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658297.161314:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e734 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e72d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.161367:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e72d expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.161379:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e72d expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658297.161389:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390c00, rc 0) 00000100:00100000:2.0:1788658297.161438:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025100160:12345-0@lo:101: Request processed in 153us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.161445:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788658297.161555:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025100160:0@lo:101: 00010000:00010000:1.0:1788658297.161571:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.161664:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658297.161755:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025100288:0@lo:501: 00000100:00100000:1.0:1788658297.161781:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658297.161799:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f3bfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.161890:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025100288 00000100:00100000:2.0:1788658297.161895:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025100288 00000100:00100000:2.0:1788658297.162029:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788658297.162037:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025100288:12345-0@lo:501: 00000100:00100000:2.0:1788658297.162118:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025100288:12345-0@lo:501: Request processed in 82us (335us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658297.162126:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000004:00080000:0.0:1788658297.162314:0:8611:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788658297.162413:0:8611:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 214378709155ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788658297.162421:0:8611:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788658297.162782:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025100288:0@lo:501: 10000000:01000000:1.0:1788658297.162819:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788658297.162827:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658297.162837:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788658297.170025:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788658297.170328:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025100416:0@lo:13: 00000100:00100000:3.0:1788658297.170407:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788658297.170452:0:8612:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788658297.170475:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875544025100544:0@lo:7: 00000100:00100000:3.0:1788658297.170501:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658297.170516:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e88579840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.170741:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025100416 00000100:00100000:2.0:1788658297.170749:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025100416 00000100:00100000:2.0:1788658297.170812:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658297.170823:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025100416:12345-0@lo:13: 00002000:00000024:2.0:1788658297.170847:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1788658297.170982:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025100416:12345-0@lo:13: Request processed in 159us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.170990:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658297.171014:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025100544 00000100:00100000:2.0:1788658297.171024:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025100544 00000100:00100000:2.0:1788658297.171050:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658297.171057:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8612:x1875544025100544:12345-0@lo:7: 00000100:00080000:3.0:1788658297.171213:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788658297.177738:0:8454:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788658297.177748:0:8454:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00080000:3.0:1788658297.177952:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eadba1180 x1875544025100416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658297.177985:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025100416:0@lo:13: 00000100:00100000:2.0:1788658297.178226:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8612:x1875544025100544:12345-0@lo:7: Request processed in 7167us (7721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658297.178236:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788658297.178431:0:8612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb2251500 x1875544025100544/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788658313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658297.178442:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875544025100544:0@lo:7: 00000004:00080000:3.0:1788658297.178453:0:8612:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788658297.178488:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875544025100672:0@lo:5: 00000100:00100000:3.0:1788658297.178523:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658297.178591:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e88579840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.178697:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025100672 00000100:00100000:2.0:1788658297.178768:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025100672 00000100:00100000:2.0:1788658297.178819:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658297.178828:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8612:x1875544025100672:12345-0@lo:5: 00002000:00080000:2.0:1788658297.178857:0:8453:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788658297.178861:0:8453:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1788658297.184151:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00100000:2.0:1788658297.184172:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788658297.184179:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1788658297.184482:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8612:x1875544025100672:12345-0@lo:5: Request processed in 5648us (5952us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788658297.184496:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788658297.186851:0:8612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb2251500 x1875544025100672/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658313 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658297.186869:0:8612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788658297.186877:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875544025100672:0@lo:5: 00000004:00080000:1.0:1788658297.186893:0:8612:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788658297.187798:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875544025100800:0@lo:700: 00000100:00100000:3.0:1788658297.187856:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658297.188411:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e88579840 going to sleep for 11 seconds 00000100:00100000:0.0:1788658297.189332:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025100800 00000100:00100000:0.0:1788658297.189352:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025100800 00000100:00100000:0.0:1788658297.190552:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658297.190568:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8612:x1875544025100800:12345-0@lo:700: 00000100:00100000:0.0:1788658297.209593:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8612:x1875544025100800:12345-0@lo:700: Request processed in 19013us (21718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.209607:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788658297.209693:0:8612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb2251880 x1875544025100800/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788658313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658297.209727:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875544025100800:0@lo:700: 00000004:02000040:0.0:1788658297.211206:0:8612:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1788658297.218071:0:8612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875544025100928:0@lo:5: 00000100:00100000:3.0:1788658297.218155:0:8612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658297.218234:0:8612:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e88579840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658297.218285:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025100928 00000100:00100000:2.0:1788658297.218366:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025100928 00000100:00100000:2.0:1788658297.218456:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658297.218468:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8612:x1875544025100928:12345-0@lo:5: 00002000:00080000:3.0:1788658297.223405:0:8454:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788658297.223423:0:8454:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788658297.225655:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8612:x1875544025100928:12345-0@lo:5: Request processed in 7182us (7493us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788658297.225669:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788658297.226243:0:8612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb2251880 x1875544025100928/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658313 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658297.226280:0:8612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8612:1875544025100928:0@lo:5: 00000004:00080000:1.0:1788658297.226359:0:8612:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1788658297.282197:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658297.796000:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658297.796030:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025101056:0@lo:41: 00000100:00100000:1.0:1788658297.796101:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658297.796881:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025101056 00000100:00100000:0.0:1788658297.796890:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025101056 00000100:00100000:0.0:1788658297.796937:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788658297.796947:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025101056:12345-0@lo:41: 00000004:00000024:0.0:1788658297.796983:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788658297.797042:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025101056:12345-0@lo:41: Request processed in 95us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658297.797048:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788658297.797096:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025101056:0@lo:41: 00010000:00010000:3.0:1788658298.305634:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658299.327504:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658300.350992:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658300.351020:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025101184:0@lo:41: 00000100:00100000:2.0:1788658300.351091:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658300.351167:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025101184 00000100:00100000:2.0:1788658300.351175:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025101184 00000100:00100000:2.0:1788658300.351221:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658300.351232:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025101184:12345-0@lo:41: 00000004:00000024:2.0:1788658300.351267:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788658300.351328:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025101184:12345-0@lo:41: Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658300.351336:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658300.351383:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025101184:0@lo:41: 00010000:00010000:1.0:1788658300.351579:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788658300.962034:0:8827:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788658301.375219:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788658301.656429:0:8879:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658301.656688:0:8879:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788658302.399393:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658302.399481:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025101312:0@lo:13: 00000100:00100000:2.0:1788658302.399559:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658302.399626:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025101312 00000100:00100000:2.0:1788658302.399634:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025101312 00000100:00100000:2.0:1788658302.399685:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658302.399695:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025101312:12345-0@lo:13: 00002000:00000024:2.0:1788658302.399741:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658302.399785:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025101312:12345-0@lo:13: Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658302.399792:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788658302.399813:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788658302.399907:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b3bb80 x1875544025101312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658302.399918:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788658302.399938:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025101312:0@lo:13: 00000100:00100000:1.0:1788658302.400582:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025101696:0@lo:400: 00000100:00100000:1.0:1788658302.400621:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658302.400643:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025102208:0@lo:400: 00000100:00100000:1.0:1788658302.400671:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658302.400691:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788658302.400697:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025101568:0@lo:400: 00000100:00100000:1.0:1788658302.400744:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658302.400761:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025102080:0@lo:400: 00000100:00100000:1.0:1788658302.400781:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658302.400804:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025101696 00000100:00100000:1.0:1788658302.400809:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025101696 00000100:00100000:3.0:1788658302.400947:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025101824:0@lo:400: 00000100:00100000:3.0:1788658302.400978:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658302.401003:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025102336:0@lo:400: 00000100:00100000:3.0:1788658302.401037:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658302.401062:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788658302.401076:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025101440:0@lo:400: 00000100:00100000:3.0:1788658302.401104:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658302.401121:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025101952:0@lo:400: 00000100:00100000:3.0:1788658302.401141:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658302.401191:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025102208 00000100:00100000:3.0:1788658302.401194:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025102208 00000100:00100000:3.0:1788658302.401220:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025101568 00000100:00100000:3.0:1788658302.401222:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025101568 00000100:00100000:3.0:1788658302.401233:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025102080 00000100:00100000:3.0:1788658302.401235:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025102080 00000100:00100000:3.0:1788658302.401245:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025101824 00000100:00100000:3.0:1788658302.401248:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025101824 00000100:00100000:3.0:1788658302.401259:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658302.401266:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025102208:12345-0@lo:400: 00000100:00100000:3.0:1788658302.401307:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025102208:12345-0@lo:400: Request processed in 42us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658302.401314:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658302.401328:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658302.401334:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025101568:12345-0@lo:400: 00000100:00100000:3.0:1788658302.401357:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025101568:12345-0@lo:400: Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658302.401362:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658302.401371:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788658302.401376:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025102080:12345-0@lo:400: 00000100:00100000:3.0:1788658302.401399:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025102080:12345-0@lo:400: Request processed in 23us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658302.401566:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025101952 00000100:00100000:1.0:1788658302.401571:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025101952 00000100:00100000:1.0:1788658302.401588:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788658302.401594:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025101696:12345-0@lo:400: 00000100:00100000:1.0:1788658302.401629:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025101696:12345-0@lo:400: Request processed in 35us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658302.401635:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788658302.401655:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788658302.401661:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025101952:12345-0@lo:400: 00000100:00100000:1.0:1788658302.401693:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025101952:12345-0@lo:400: Request processed in 33us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658302.401718:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788658302.401737:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658302.401744:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025101824:12345-0@lo:400: 00000100:00100000:1.0:1788658302.401770:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025101824:12345-0@lo:400: Request processed in 28us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658302.401776:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1788658302.401817:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658302.401953:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025102464:0@lo:13: 00000100:00100000:1.0:1788658302.402496:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025101952:0@lo:400: 00000100:00100000:3.0:1788658302.402555:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788658302.402583:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025102336 00000100:00100000:3.0:1788658302.402593:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025102336 00000100:00100000:3.0:1788658302.402627:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658302.402634:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025102336:12345-0@lo:400: 00000100:00100000:2.0:1788658302.405633:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658302.405737:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025101440 00000100:00100000:2.0:1788658302.405745:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025101440 00000100:00100000:2.0:1788658302.405792:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788658302.405803:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3647:x1875544025101440:12345-0@lo:400: 00000100:00100000:2.0:1788658302.405881:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3647:x1875544025101440:12345-0@lo:400: Request processed in 79us (4775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658302.405888:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1788658302.405925:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658302.405931:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658302.405933:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658302.405944:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025102464 00000100:00100000:2.0:1788658302.405948:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025102464 00000100:00100000:2.0:1788658302.405974:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658302.405981:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875544025102464:12345-0@lo:13: 00002000:00000024:2.0:1788658302.405997:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658302.406037:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875544025102464:12345-0@lo:13: Request processed in 56us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658302.406043:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788658302.406079:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb5eec700 x1875544025102464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658302.406100:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025102464:0@lo:13: 00010000:00080000:1.0:1788658302.408663:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb9b100 x1875544025101824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658302.408681:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025101824:0@lo:400: 00000100:00100000:1.0:1788658302.408970:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025101440:0@lo:400: 00010000:00080000:1.0:1788658302.409106:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb98e00 x1875544025101568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658302.409117:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025101568:0@lo:400: 00010000:00080000:1.0:1788658302.409132:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb5eef100 x1875544025102080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658302.409140:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025102080:0@lo:400: 00000100:00100000:1.0:1788658302.409153:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025101696:0@lo:400: 00010000:00080000:1.0:1788658302.409178:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb5eedf80 x1875544025102208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658302.409187:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025102208:0@lo:400: 00000100:00100000:3.0:1788658302.410499:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025102336:12345-0@lo:400: Request processed in 7859us (9455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658302.410512:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788658302.410729:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb5eeed80 x1875544025102336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658302.410743:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025102336:0@lo:400: 00000001:00080000:0.0:1788658302.419940:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788658302.910953:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658302.911342:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025102592:0@lo:41: 00000100:00100000:3.0:1788658302.911412:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658302.911561:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025102592 00000100:00100000:1.0:1788658302.911580:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025102592 00000100:00100000:1.0:1788658302.911635:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658302.911646:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025102592:12345-0@lo:41: 00000004:00000024:1.0:1788658302.911679:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788658302.913393:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025102592:12345-0@lo:41: Request processed in 1741us (1972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658302.913406:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788658302.913621:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025102592:0@lo:41: 00010000:00010000:1.0:1788658303.423174:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788658304.174490:0:8981:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658304.175031:0:8981:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788658304.452074:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788658305.021196:0:9029:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658305.021207:0:9029:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1788658305.471849:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658305.471878:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025102720:0@lo:41: 00000100:00100000:1.0:1788658305.471945:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658305.472154:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658305.472168:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025102720 00000100:00100000:2.0:1788658305.472175:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025102720 00000100:00100000:2.0:1788658305.472226:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658305.472234:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025102720:12345-0@lo:41: 00000004:00000024:2.0:1788658305.472265:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788658305.472311:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025102720:12345-0@lo:41: Request processed in 78us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658305.472318:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788658305.472435:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025102720:0@lo:41: 00010000:00010000:0.0:1788658306.494881:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658307.519673:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658307.520108:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025102848:0@lo:400: 00000100:00100000:1.0:1788658307.520183:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658307.520228:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025103360:0@lo:400: 00000100:00100000:1.0:1788658307.520284:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658307.520316:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788658307.520322:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025102976:0@lo:400: 00000100:00100000:1.0:1788658307.520345:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658307.520465:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025103488:0@lo:13: 00000100:00100000:1.0:1788658307.520492:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658307.520758:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025103104:0@lo:400: 00000100:00100000:1.0:1788658307.520785:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658307.520805:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658307.520810:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025103232:0@lo:400: 00000100:00100000:1.0:1788658307.520831:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658307.520865:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025103360 00000100:00100000:1.0:1788658307.520872:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025103360 00000100:00100000:1.0:1788658307.520910:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025103104 00000100:00100000:1.0:1788658307.520913:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025103104 00000100:00100000:1.0:1788658307.520928:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658307.520936:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025103360:12345-0@lo:400: 00000100:00100000:3.0:1788658307.521245:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658307.521341:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025103360:12345-0@lo:400: Request processed in 405us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658307.521349:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658307.521375:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658307.521382:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025103104:12345-0@lo:400: 00000100:00100000:3.0:1788658307.521428:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025103616:0@lo:400: 00000100:00100000:3.0:1788658307.521465:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658307.521505:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025102848 00000100:00100000:3.0:1788658307.521510:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025102848 00000100:00100000:3.0:1788658307.521550:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788658307.521556:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e88550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3647:x1875544025102848:12345-0@lo:400: 00000100:00100000:3.0:1788658307.521588:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e88550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3647:x1875544025102848:12345-0@lo:400: Request processed in 32us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658307.521593:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788658307.521623:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025102976 00000100:00100000:3.0:1788658307.521627:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025102976 00000100:00100000:3.0:1788658307.521658:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025103232 00000100:00100000:3.0:1788658307.521661:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025103232 00000100:00100000:3.0:1788658307.521675:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025103616 00000100:00100000:3.0:1788658307.521677:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025103616 00000100:00100000:3.0:1788658307.521697:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658307.521722:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025102976:12345-0@lo:400: 00000100:00100000:3.0:1788658307.521771:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025102976:12345-0@lo:400: Request processed in 67us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658307.521778:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658307.521794:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658307.521800:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025103232:12345-0@lo:400: 00000100:00100000:1.0:1788658307.521946:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025103104:12345-0@lo:400: Request processed in 551us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658307.521956:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658307.521986:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788658307.521995:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025103616:12345-0@lo:400: 00000100:00100000:1.0:1788658307.522031:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025103616:12345-0@lo:400: Request processed in 38us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658307.522037:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788658307.522061:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025103488 00000100:00100000:1.0:1788658307.522066:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025103488 00000100:00100000:1.0:1788658307.522093:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658307.522100:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025103488:12345-0@lo:13: 00002000:00000024:1.0:1788658307.522124:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658307.522155:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025103488:12345-0@lo:13: Request processed in 56us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658307.522161:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658307.522437:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025103232:12345-0@lo:400: Request processed in 636us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658307.522444:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788658307.522467:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658307.522471:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658307.522482:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025103744:0@lo:400: 00000100:00100000:3.0:1788658307.522515:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788658307.522550:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b38000 x1875544025103616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658307.522565:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025103616:0@lo:400: 00000100:00100000:3.0:1788658307.522590:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025103744 00000100:00100000:3.0:1788658307.522594:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025103744 00000100:00100000:3.0:1788658307.522623:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658307.522629:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025103744:12345-0@lo:400: 00000100:00100000:3.0:1788658307.522662:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025103744:12345-0@lo:400: Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658307.522669:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788658307.522681:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788658307.522696:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b39880 x1875544025103744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658307.522728:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025103744:0@lo:400: 00010000:00080000:1.0:1788658307.522924:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b3b800 x1875544025103232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658307.522934:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025103232:0@lo:400: 00000100:00100000:1.0:1788658307.522945:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025103104:0@lo:400: 00010000:00080000:1.0:1788658307.522975:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b3a680 x1875544025102976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658307.522994:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025102976:0@lo:400: 00010000:00080000:1.0:1788658307.523008:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb5eeed80 x1875544025103488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658307.523016:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788658307.523031:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025103488:0@lo:13: 00000100:00100000:1.0:1788658307.523042:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025102848:0@lo:400: 00000100:00100000:1.0:1788658307.523053:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025103360:0@lo:400: 00000100:00100000:3.0:1788658307.523333:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025103872:0@lo:13: 00000100:00100000:3.0:1788658307.523363:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658307.523423:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025103872 00000100:00100000:1.0:1788658307.523427:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025103872 00000100:00100000:1.0:1788658307.523465:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658307.523471:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025103872:12345-0@lo:13: 00002000:00000024:1.0:1788658307.523483:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658307.523513:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025103872:12345-0@lo:13: Request processed in 42us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658307.523519:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788658307.523564:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788658307.523580:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb5eeed80 x1875544025103872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658307.523593:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025103872:0@lo:13: 00000100:00100000:0.0:1788658308.032969:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658308.032998:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025104000:0@lo:41: 00000100:00100000:0.0:1788658308.033066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658308.033131:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025104000 00000100:00100000:0.0:1788658308.033147:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025104000 00000100:00100000:0.0:1788658308.033192:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658308.033200:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025104000:12345-0@lo:41: 00000004:00000024:0.0:1788658308.033236:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788658308.033283:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025104000:12345-0@lo:41: Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658308.033290:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658308.033336:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025104000:0@lo:41: 00010000:00010000:2.0:1788658308.544135:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658309.578778:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658310.592023:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025104128:0@lo:41: 00000100:00100000:1.0:1788658310.592093:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658310.592168:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025104128 00000100:00100000:1.0:1788658310.592176:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025104128 00000100:00100000:1.0:1788658310.592222:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658310.592232:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025104128:12345-0@lo:41: 00000004:00000024:1.0:1788658310.592267:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788658310.592314:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025104128:12345-0@lo:41: Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658310.592321:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658310.592367:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025104128:0@lo:41: 00010000:00010000:1.0:1788658310.603539:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658311.617209:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658312.638999:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025104640:0@lo:400: 00000100:00100000:2.0:1788658312.639077:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658312.639128:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025105152:0@lo:400: 00000100:00100000:2.0:1788658312.639156:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658312.639182:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788658312.639187:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025104256:0@lo:400: 00000100:00100000:2.0:1788658312.639214:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658312.639250:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025104768:0@lo:400: 00000100:00100000:2.0:1788658312.639273:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658312.639290:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025105280:0@lo:400: 00000100:00100000:2.0:1788658312.639311:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658312.639339:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025104384:0@lo:400: 00000100:00100000:2.0:1788658312.639360:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658312.639377:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025104896:0@lo:400: 00000100:00100000:2.0:1788658312.639403:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658312.639418:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788658312.639423:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025104512:0@lo:400: 00000100:00100000:2.0:1788658312.639440:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658312.639454:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025105024:0@lo:400: 00000100:00100000:2.0:1788658312.639471:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658312.639501:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025104640 00000100:00100000:2.0:1788658312.639507:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025104640 00000100:00100000:2.0:1788658312.639539:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025104384 00000100:00100000:2.0:1788658312.639541:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025104384 00000100:00100000:2.0:1788658312.639561:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025104896 00000100:00100000:2.0:1788658312.639564:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025104896 00000100:00100000:2.0:1788658312.639584:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025105024 00000100:00100000:2.0:1788658312.639587:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025105024 00000100:00100000:2.0:1788658312.639600:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658312.639607:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025104640:12345-0@lo:400: 00000100:00100000:2.0:1788658312.639652:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025104640:12345-0@lo:400: Request processed in 46us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658312.639659:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658312.639673:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788658312.639678:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025104384:12345-0@lo:400: 00000100:00100000:2.0:1788658312.639700:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025104384:12345-0@lo:400: Request processed in 22us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658312.639729:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788658312.639740:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658312.639745:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025104896:12345-0@lo:400: 00000100:00100000:2.0:1788658312.639769:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025104896:12345-0@lo:400: Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658312.639775:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658312.639786:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788658312.639792:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025105024:12345-0@lo:400: 00000100:00100000:2.0:1788658312.639814:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025105024:12345-0@lo:400: Request processed in 23us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658312.639819:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788658312.639835:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025105152 00000100:00100000:2.0:1788658312.639838:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025105152 00000100:00100000:2.0:1788658312.639863:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025105280 00000100:00100000:2.0:1788658312.639872:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025105280 00000100:00100000:2.0:1788658312.639890:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658312.639896:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025105152:12345-0@lo:400: 00000100:00100000:2.0:1788658312.639925:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025105152:12345-0@lo:400: Request processed in 30us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658312.639931:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658312.639951:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658312.639957:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025105280:12345-0@lo:400: 00000100:00100000:2.0:1788658312.639982:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025105280:12345-0@lo:400: Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658312.639987:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658312.640005:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025104768 00000100:00100000:2.0:1788658312.640009:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025104768 00000100:00100000:2.0:1788658312.640029:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025104512 00000100:00100000:2.0:1788658312.640031:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025104512 00000100:00100000:2.0:1788658312.640042:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788658312.640048:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025104768:12345-0@lo:400: 00000100:00100000:2.0:1788658312.640079:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025104768:12345-0@lo:400: Request processed in 31us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658312.640085:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788658312.640095:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788658312.640100:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025104512:12345-0@lo:400: 00000100:00100000:2.0:1788658312.640125:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025104512:12345-0@lo:400: Request processed in 25us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658312.640130:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788658312.640161:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658312.640166:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658312.640168:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658312.640212:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025104512:0@lo:400: 00010000:00080000:2.0:1788658312.640228:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b3b800 x1875544025105024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658312.640237:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025105024:0@lo:400: 00010000:00080000:2.0:1788658312.640246:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b3aa00 x1875544025104384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658312.640254:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025104384:0@lo:400: 00010000:00080000:2.0:1788658312.640263:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b38700 x1875544025104896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658312.640269:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025104896:0@lo:400: 00000100:00100000:2.0:1788658312.640303:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025104768:0@lo:400: 00010000:00080000:2.0:1788658312.640315:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b38000 x1875544025105280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658312.640323:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025105280:0@lo:400: 00010000:00080000:2.0:1788658312.640332:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b3b480 x1875544025104640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658312.640338:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025104640:0@lo:400: 00010000:00080000:2.0:1788658312.640348:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d81b39880 x1875544025105152/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658312.640356:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025105152:0@lo:400: 00010000:00010000:0.0:1788658312.642015:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658312.642025:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658312.642042:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025105408:0@lo:13: 00000100:00100000:0.0:1788658312.642099:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658312.642147:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025105408 00000100:00100000:0.0:1788658312.642154:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025105408 00000100:00100000:0.0:1788658312.642192:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658312.642200:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025105408:12345-0@lo:13: 00002000:00000024:0.0:1788658312.642239:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658312.642280:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025105408:12345-0@lo:13: Request processed in 81us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658312.642287:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788658312.642326:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb377f100 x1875544025105408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658312.642343:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025105408:0@lo:13: 00000100:00100000:2.0:1788658312.643313:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025104256 00000100:00100000:2.0:1788658312.643322:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025104256 00000100:00100000:2.0:1788658312.643375:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788658312.643383:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3649:x1875544025104256:12345-0@lo:400: 00000100:00100000:2.0:1788658312.643445:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3649:x1875544025104256:12345-0@lo:400: Request processed in 64us (4230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658312.643453:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788658312.643495:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025104256:0@lo:400: 00000100:00100000:1.0:1788658312.646087:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025105536:0@lo:13: 00000100:00100000:1.0:1788658312.646147:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658312.646216:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025105536 00000100:00100000:3.0:1788658312.646223:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025105536 00000100:00100000:3.0:1788658312.646261:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658312.646268:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025105536:12345-0@lo:13: 00002000:00000024:3.0:1788658312.646286:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658312.649056:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025105536:12345-0@lo:13: Request processed in 2777us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658312.649072:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788658312.652064:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb377f100 x1875544025105536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658312.652094:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025105536:0@lo:13: 00000100:00100000:3.0:1788658313.155007:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025105664:0@lo:41: 00000100:00100000:3.0:1788658313.155087:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658313.155366:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025105664 00000100:00100000:3.0:1788658313.155374:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025105664 00000100:00100000:3.0:1788658313.155423:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788658313.155432:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025105664:12345-0@lo:41: 00000004:00000024:3.0:1788658313.155472:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788658313.155520:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025105664:12345-0@lo:41: Request processed in 89us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658313.155529:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788658313.155576:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025105664:0@lo:41: 00010000:00010000:1.0:1788658313.664118:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788658314.398075:0:9528:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788658314.398089:0:9528:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788658314.398091:0:9528:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788658314.399381:0:9528:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1d8230c000 00000020:01000004:3.0:1788658314.399403:0:9528:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788658314.399417:0:9528:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788658314.399433:0:9528:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a1d821bb380) 00000020:00000080:3.0:1788658314.399450:0:9528:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788658314.437696:0:9528:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788658314.438042:0:9528:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788658314.480154:0:9528:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788658314.481117:0:9528:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788658314.481137:0:9528:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788658314.481151:0:9528:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x48e67cc629c6e742 00000020:01000004:3.0:1788658314.481159:0:9528:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788658314.481182:0:9528:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788658314.481186:0:9528:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788658314.481192:0:9528:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788658314.481226:0:9528:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788658314.481231:0:9528:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788658314.521321:0:9528:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788658314.521365:0:9528:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.153@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788658314.521370:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788658314.521371:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658314.521373:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658314.521374:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658314.521375:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658314.521376:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658314.521378:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658314.521379:0:9528:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658314.521380:0:9528:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658314.521382:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658314.521383:0:9528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658314.521387:0:9528:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788658314.521389:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658314.521390:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658314.521391:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658314.521392:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658314.521393:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658314.521394:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658314.521395:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658314.521396:0:9528:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658314.521397:0:9528:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658314.521398:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658314.521399:0:9528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658314.521429:0:9528:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788658314.521451:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025105792:0@lo:253: 00000100:00100000:2.0:1788658314.521546:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658314.521611:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658314.522076:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025105792 00000100:00100000:3.0:1788658314.522085:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025105792 00000100:00100000:3.0:1788658314.522138:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788658314.522149:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e915d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:9528:x1875544025105792:12345-0@lo:253: 20000000:01000000:3.0:1788658314.522184:0:6529:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788658314.522189:0:6529:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788658314.522195:0:6529:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788658314.522198:0:6529:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788658314.522456:0:6529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658314.522756:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788658314.522774:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788658314.522793:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788658314.522900:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788658314.522924:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788658314.522940:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788658314.523302:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788658314.523324:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:3.0:1788658314.523326:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:3.0:1788658314.523344:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788658314.523355:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788658314.523374:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788658314.523381:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:3.0:1788658314.523401:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788658314.523409:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788658314.523429:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788658314.523455:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788658314.523550:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788658314.523563:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:3.0:1788658314.523565:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:3.0:1788658314.523582:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788658314.523696:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788658314.523746:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788658314.523755:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:3.0:1788658314.523771:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788658314.523779:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788658314.523793:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788658314.523879:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788658314.524302:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788658314.524318:0:6529:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.153@tcp 20000000:01000000:3.0:1788658314.524321:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.153@tcp (null) (null) (null) 00000040:00080000:3.0:1788658314.524337:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788658314.524344:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788658314.524359:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788658314.524365:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.153@tcp (null) (null) 00000040:00080000:3.0:1788658314.524384:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788658314.524402:0:6529:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788658314.524426:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788658314.524448:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788658314.524465:0:6529:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788658314.524468:0:6529:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788658314.524471:0:6529:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788658314.524527:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788658314.524530:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788658314.525227:0:9534:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788658314.525252:0:9534:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788658314.525268:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788658314.525376:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788658314.525397:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788658314.525414:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1788658314.525423:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788658314.525425:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788658314.525861:0:9535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1788658314.526107:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1788658314.526130:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1788658314.526144:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1788658314.526161:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788658314.526163:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788658314.526510:0:9536:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1788658314.526538:0:9536:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1788658314.526549:0:9536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788658314.526690:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788658314.526749:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1788658314.526765:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1788658314.526774:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788658314.526776:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788658314.527207:0:9537:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1788658314.527226:0:9537:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1788658314.527241:0:9537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1788658314.527440:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1788658314.527462:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1788658314.527476:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1788658314.527484:0:6529:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788658314.527486:0:6529:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788658314.529723:0:9538:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788658314.529773:0:9538:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788658314.529794:0:9538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788658314.529921:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788658314.529943:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788658314.529960:0:6529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:3.0:1788658314.529981:0:6529:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788658314.530003:0:6529:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530034:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e63f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e638 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530043:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e81670a00/0x48e67cc629c6e669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e662 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530067:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e80031a00/0x48e67cc629c6e6a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e6a1 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530074:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e6c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e6bd expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530081:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e6e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e6e0 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530089:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e70a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e703 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530097:0:6529:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e734 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e72d expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530106:0:6529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530148:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e72d expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530164:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e734 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e72d expref: 21 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.530177:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025105920:0@lo:104: 00000100:00100000:3.0:1788658314.530239:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658314.530296:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e703 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530305:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e70a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e703 expref: 21 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.530323:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106048:0@lo:104: 00000100:00100000:3.0:1788658314.530345:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658314.530384:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e6e0 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530393:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e6e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e6e0 expref: 21 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.530402:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106176:0@lo:104: 00000100:00100000:3.0:1788658314.530438:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658314.530457:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e6bd expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658314.530461:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025105920 00010000:00010000:3.0:1788658314.530467:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e6c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e6bd expref: 21 pid: 6529 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658314.530471:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025105920 00000100:00100000:3.0:1788658314.530480:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106304:0@lo:104: 00000100:00100000:3.0:1788658314.530509:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658314.530515:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025106048 00000100:00100000:1.0:1788658314.530519:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025106048 00010000:00010000:3.0:1788658314.530531:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e80031a00/0x48e67cc629c6e6a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e6a1 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658314.530534:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025106176 00000100:00100000:1.0:1788658314.530538:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025106176 00010000:00010000:3.0:1788658314.530546:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e80031a00/0x48e67cc629c6e6a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e6a1 expref: 21 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658314.530550:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025106304 00000100:00100000:1.0:1788658314.530554:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025106304 00000100:00100000:3.0:1788658314.530560:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106432:0@lo:104: 00000100:00100000:1.0:1788658314.530570:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658314.530581:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:6529:x1875544025105920:12345-0@lo:104: 00000100:00100000:3.0:1788658314.530589:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658314.530599:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530610:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e81670a00/0x48e67cc629c6e669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e662 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.530632:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e81670a00/0x48e67cc629c6e669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e662 expref: 21 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.530643:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106560:0@lo:104: 00010000:00010000:1.0:1788658314.530664:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658314.530672:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:6529:x1875544025105920:12345-0@lo:104: Request processed in 93us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.530678:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658314.530687:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1788658314.530734:0:6529:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e63f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e638 expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658314.530740:0:6520:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788658314.530744:0:6529:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e63f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e638 expref: 21 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658314.530753:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025106432 00000100:00100000:3.0:1788658314.530757:0:6529:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106688:0@lo:104: 00000100:00100000:1.0:1788658314.530759:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025106432 00000100:00100000:1.0:1788658314.530779:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025106560 00000100:00100000:1.0:1788658314.530782:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025106560 00000100:00100000:3.0:1788658314.530788:0:6529:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658314.530799:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025106688 00000100:00100000:3.0:1788658314.530803:0:6529:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658314.530804:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025106688 00000100:00100000:1.0:1788658314.530823:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658314.530830:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef6a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025105920:0@lo:104: 00000100:00100000:1.0:1788658314.530832:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+8:6529:x1875544025106048:12345-0@lo:104: 00010000:00010000:1.0:1788658314.530844:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.530900:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788658314.530907:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+8:6529:x1875544025106048:12345-0@lo:104: Request processed in 78us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.530932:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106048:0@lo:104: 00000100:00100000:1.0:1788658314.531286:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658314.531385:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658314.531393:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+7:6529:x1875544025106176:12345-0@lo:104: 00010000:00010000:1.0:1788658314.531402:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.531453:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788658314.531459:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+7:6529:x1875544025106176:12345-0@lo:104: Request processed in 68us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.531465:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658314.531478:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658314.531483:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:6529:x1875544025106304:12345-0@lo:104: 00010000:00010000:1.0:1788658314.531492:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.531520:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788658314.531526:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:6529:x1875544025106304:12345-0@lo:104: Request processed in 43us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.531531:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658314.531543:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658314.531549:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:6529:x1875544025106432:12345-0@lo:104: 00010000:00010000:1.0:1788658314.531558:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.531585:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788658314.531591:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:6529:x1875544025106432:12345-0@lo:104: Request processed in 42us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.531604:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658314.531618:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658314.531624:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d82413050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6529:x1875544025106560:12345-0@lo:104: 00010000:00010000:1.0:1788658314.531632:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.531662:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106176:0@lo:104: 00010000:00010000:1.0:1788658314.531673:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788658314.531678:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106304:0@lo:104: 00000100:00100000:1.0:1788658314.531682:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d82413050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6529:x1875544025106560:12345-0@lo:104: Request processed in 56us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.531690:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106432:0@lo:104: 00000100:00100000:1.0:1788658314.531693:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788658314.531720:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106560:0@lo:104: 00010000:00010000:0.0:1788658314.531822:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788658314.531829:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.531838:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658314.531842:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.531853:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658314.531861:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658314.531869:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658314.531904:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.531925:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658314.531950:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.531966:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6e72d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e734 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.531970:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658314.531986:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025106816:0@lo:103: 00010000:00010000:0.0:1788658314.531988:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788658314.531994:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532001:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658314.532005:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532024:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658314.532032:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.532036:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788658314.532043:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658314.532064:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532071:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658314.532089:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532097:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0400/0x48e67cc629c6e703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e70a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532108:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788658314.532117:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532124:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658314.532127:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532135:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658314.532142:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658314.532148:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658314.532164:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532170:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658314.532176:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532184:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e6e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6e7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532195:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788658314.532198:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532204:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030c00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658314.532208:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532225:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658314.532232:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658314.532237:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658314.532253:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532260:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658314.532274:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532281:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e80030c00/0x48e67cc629c6e6bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6c4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532294:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788658314.532301:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025107200:0@lo:103: 00000100:00100000:3.0:1788658314.532325:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658314.532362:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025106816 00000100:00100000:3.0:1788658314.532368:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025106816 00010000:00010000:3.0:1788658314.532392:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e734 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e72d expref: 22 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.532415:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025107200 00000100:00100000:3.0:1788658314.532417:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025107200 00010000:00010000:3.0:1788658314.532428:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e6c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e6bd expref: 23 pid: 6529 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532433:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.532442:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788658314.532442:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658314.532448:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.532455:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:3649:x1875544025106816:12345-0@lo:103: 00010000:00010000:0.0:1788658314.532462:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.532468:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:0.0:1788658314.532470:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.532475:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e734 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e72d expref: 23 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658314.532496:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658314.532501:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e734 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e72d expref: 23 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532516:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.532518:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e734 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e72d expref: 23 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532532:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658314.532542:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658314.532546:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532555:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e6a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6a8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532569:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658314.532572:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.532573:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:3649:x1875544025106816:12345-0@lo:103: Request processed in 122us (539us total) trans 0 rc 0/0 00010000:00010000:0.0:1788658314.532587:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658314.532591:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532598:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658314.532604:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658314.532610:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658314.532622:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532627:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658314.532652:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532659:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390200/0x48e67cc629c6e662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e669 expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.532670:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658314.532672:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658314.532674:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658314.532693:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025107328:0@lo:103: 00000100:00100000:3.0:1788658314.532795:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658314.532815:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658314.532823:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3649:x1875544025107200:12345-0@lo:103: 00010000:00010000:3.0:1788658314.532831:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658314.532836:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e6c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e6bd expref: 21 pid: 6529 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.532852:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e6c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e6bd expref: 21 pid: 6529 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.532864:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e6c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e6bd expref: 21 pid: 6529 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.532874:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658314.532902:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:3649:x1875544025107200:12345-0@lo:103: Request processed in 80us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.532909:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658314.533389:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.533445:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025106944:0@lo:103: 00000100:00100000:0.0:1788658314.533474:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.533485:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025107456:0@lo:103: 00000100:00100000:0.0:1788658314.533504:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.533515:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658314.533521:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025107072:0@lo:103: 00000100:00100000:0.0:1788658314.533541:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.533589:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025107200:0@lo:103: 00000100:00100000:0.0:1788658314.533599:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025106816:0@lo:103: 00000100:00100000:1.0:1788658314.533807:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658314.533820:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6529:x1875544025106688:12345-0@lo:104: 00010000:00010000:1.0:1788658314.533832:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.533892:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658314.533898:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6529:x1875544025106688:12345-0@lo:104: Request processed in 83us (3111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.533905:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788658314.534126:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658314.534132:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.534140:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391c00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658314.534144:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.534169:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658314.534176:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658314.534182:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658314.534207:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.534213:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658314.534224:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.534231:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e638 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e63f expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.534246:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658314.534248:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658314.534249:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658314.534256:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658314.534267:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025107328 00000100:00100000:1.0:1788658314.534273:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025107328 00010000:00010000:1.0:1788658314.534295:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e80031a00/0x48e67cc629c6e6a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e6a1 expref: 20 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.534414:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658314.534433:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025107584:0@lo:103: 00000100:00100000:0.0:1788658314.534465:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658314.534562:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025106944 00000100:00100000:3.0:1788658314.534567:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025106944 00010000:00010000:3.0:1788658314.534584:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e70a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e703 expref: 21 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.534600:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025107456 00000100:00100000:3.0:1788658314.534602:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025107456 00010000:00010000:3.0:1788658314.534614:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e81670a00/0x48e67cc629c6e669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e662 expref: 22 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.534625:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025107072 00000100:00100000:3.0:1788658314.534627:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025107072 00010000:00010000:3.0:1788658314.534637:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e6e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e6e0 expref: 23 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.534646:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025107584 00000100:00100000:3.0:1788658314.534649:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025107584 00010000:00010000:3.0:1788658314.534659:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e63f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e638 expref: 24 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.534670:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658314.534683:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e8859e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025106944:12345-0@lo:103: 00010000:00010000:3.0:1788658314.534693:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658314.534698:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e70a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e703 expref: 24 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.534733:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e70a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e703 expref: 24 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.534746:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e70a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e703 expref: 24 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.534756:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658314.534792:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e8859e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:3647:x1875544025106944:12345-0@lo:103: Request processed in 110us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.534799:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658314.534814:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658314.534820:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:3647:x1875544025107456:12345-0@lo:103: 00010000:00010000:3.0:1788658314.534828:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658314.534832:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e81670a00/0x48e67cc629c6e669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e662 expref: 22 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.534840:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e81670a00/0x48e67cc629c6e669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e662 expref: 22 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.534850:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81670a00/0x48e67cc629c6e669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e662 expref: 22 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.534858:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658314.534880:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3647:x1875544025107456:12345-0@lo:103: Request processed in 61us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.535647:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025106944:0@lo:103: 00000100:00100000:0.0:1788658314.535661:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025107456:0@lo:103: 00000100:00100000:1.0:1788658314.535768:0:6522:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788658314.535778:0:6522:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788658314.535802:0:6521:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788658314.535811:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658314.535829:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3647:x1875544025107072:12345-0@lo:103: 00010000:00010000:1.0:1788658314.535841:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658314.535847:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e6e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e6e0 expref: 21 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.535858:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e6e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e6e0 expref: 21 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.535871:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e6e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e6e0 expref: 21 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.535885:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658314.535940:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:3647:x1875544025107072:12345-0@lo:103: Request processed in 113us (2398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.535948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658314.535963:0:6521:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788658314.535970:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658314.535975:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:3648:x1875544025107584:12345-0@lo:103: 00010000:00010000:1.0:1788658314.535983:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658314.535987:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e63f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e638 expref: 19 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.535995:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e63f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e638 expref: 19 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536006:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658314.536045:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:3648:x1875544025107584:12345-0@lo:103: Request processed in 70us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.536051:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658314.536072:0:6521:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788658314.536078:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658314.536085:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:3650:x1875544025107328:12345-0@lo:103: 00010000:00010000:1.0:1788658314.536094:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658314.536098:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e80031a00/0x48e67cc629c6e6a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e6a1 expref: 18 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536109:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e80031a00/0x48e67cc629c6e6a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e6a1 expref: 18 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536120:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80031a00/0x48e67cc629c6e6a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e6a1 expref: 18 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536134:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536143:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536157:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536166:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536174:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536182:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536188:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658314.536198:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536207:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536216:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536227:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658314.536255:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3650:x1875544025107328:12345-0@lo:103: Request processed in 170us (2867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.536261:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788658314.536342:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6e63f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e638 expref: 16 pid: 6530 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658314.536353:0:6529:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6529:1875544025106688:0@lo:104: 00010000:00010000:1.0:1788658314.536394:0:6529:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536404:0:6529:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536410:0:6529:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.536416:0:6529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e749 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788658314.536431:0:6529:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788658314.538410:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788658314.539507:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025107072:0@lo:103: 00000100:00100000:0.0:1788658314.539567:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025107584:0@lo:103: 00000100:00100000:0.0:1788658314.539606:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025107328:0@lo:103: 00000100:00100000:3.0:1788658314.543333:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e915d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:9528:x1875544025105792:12345-0@lo:253: Request processed in 21175us (21776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.543352:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788658314.543510:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025105792:0@lo:253: 10000000:01000000:2.0:1788658314.543529:0:9528:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788658314.543532:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658314.543534:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658314.543535:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658314.543537:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788658314.543538:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658314.543540:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658314.543541:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658314.543543:0:9528:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788658314.543544:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658314.543545:0:9528:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788658314.543568:0:9528:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1d8230c000 from lustre-OST0001 10000000:01000000:2.0:1788658314.543593:0:9528:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788658314.543596:0:9528:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788658314.543606:0:9528:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1eae393380 local copy 10000000:01000000:2.0:1788658314.543610:0:9528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788658314.543651:0:9528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.543663:0:9528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.543674:0:9528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658314.543739:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025107712:0@lo:101: 00000100:00100000:2.0:1788658314.543777:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658314.543812:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788658314.543995:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025107712 00000100:00100000:0.0:1788658314.544003:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025107712 00000100:00100000:0.0:1788658314.544057:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788658314.544067:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+14:9528:x1875544025107712:12345-0@lo:101: 00010000:00010000:0.0:1788658314.544079:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658314.544092:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e80031600/0x48e67cc629c6e757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e750 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.544116:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e80031600/0x48e67cc629c6e757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e750 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.544127:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e80031600/0x48e67cc629c6e757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e750 expref: 15 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.544136:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031600, rc 0) 00000100:00100000:0.0:1788658314.544251:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:9528:x1875544025107712:12345-0@lo:101: Request processed in 186us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.544258:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788658314.545546:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025107712:0@lo:101: 00010000:00010000:3.0:1788658314.545567:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.545578:0:9528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.545825:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025107840:0@lo:501: 00000100:00100000:3.0:1788658314.545874:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658314.546041:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658314.546261:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025107840 00000100:00100000:1.0:1788658314.546284:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025107840 00000100:00100000:1.0:1788658314.546432:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788658314.546442:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:9528:x1875544025107840:12345-0@lo:501: 00000100:00100000:1.0:1788658314.546530:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:9528:x1875544025107840:12345-0@lo:501: Request processed in 90us (654us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658314.546539:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788658314.546605:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025107840:0@lo:501: 10000000:01000000:3.0:1788658314.546619:0:9528:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788658314.546637:0:9528:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788658314.546644:0:9528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.546652:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.546660:0:9528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.546687:0:9528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788658314.546745:0:9528:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1d8230c000 10000000:01000000:3.0:1788658314.546751:0:9528:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788658314.546757:0:9528:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788658314.546760:0:9528:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658314.546765:0:9528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788658314.546768:0:9528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788658314.546790:0:9528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.546799:0:9528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.546808:0:9528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.546821:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025107968:0@lo:101: 00000100:00100000:3.0:1788658314.546849:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658314.546904:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658314.546910:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.546927:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390600 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658314.546930:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.546950:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658314.546958:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658314.546964:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658314.546983:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.546990:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658314.547006:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.547023:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390600/0x48e67cc629c6e750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x48e67cc629c6e757 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.547038:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658314.547039:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658314.547041:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658314.547049:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658314.547060:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025108096:0@lo:103: 00000100:00100000:0.0:1788658314.547088:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658314.547489:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658314.547557:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025107968 00000100:00100000:2.0:1788658314.547564:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025107968 00000100:00100000:2.0:1788658314.547595:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788658314.547603:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:9528:x1875544025107968:12345-0@lo:101: 00010000:00010000:2.0:1788658314.547614:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658314.547628:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e75e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.547649:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e75e expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.547660:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e75e expref: 16 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.547669:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390c00, rc 0) 00000100:00100000:2.0:1788658314.547732:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025107968:12345-0@lo:101: Request processed in 129us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658314.547738:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788658314.547817:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025107968:0@lo:101: 00010000:00010000:3.0:1788658314.547829:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.547838:0:9528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.548061:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108224:0@lo:501: 00000100:00100000:3.0:1788658314.548092:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658314.548114:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658314.548164:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025108224 00000100:00100000:2.0:1788658314.548170:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025108224 00000100:00100000:2.0:1788658314.548189:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788658314.548195:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108224:12345-0@lo:501: 00000100:00100000:2.0:1788658314.548370:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108224:12345-0@lo:501: Request processed in 174us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658314.548389:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788658314.548447:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108224:0@lo:501: 00000100:00100000:3.0:1788658314.548481:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108352:0@lo:503: 00000100:00100000:3.0:1788658314.548525:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658314.548546:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658314.548586:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025108352 00000100:00100000:2.0:1788658314.548590:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025108352 00000100:00100000:2.0:1788658314.548608:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788658314.548614:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108352:12345-0@lo:503: 00000100:00100000:2.0:1788658314.548726:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108352:12345-0@lo:503: Request processed in 87us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658314.548733:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788658314.548814:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108352:0@lo:503: 00000040:00080000:3.0:1788658314.549211:0:9528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788658314.549519:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108480:0@lo:502: 00000100:00100000:3.0:1788658314.549569:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658314.549592:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658314.550799:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025108480 00000100:00100000:1.0:1788658314.550811:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025108480 00000100:00100000:1.0:1788658314.550856:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788658314.550865:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108480:12345-0@lo:502: 00000100:00100000:1.0:1788658314.551028:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108480:12345-0@lo:502: Request processed in 163us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.551035:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788658314.551089:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025108096 00000100:00100000:1.0:1788658314.551094:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025108096 00000100:00100000:1.0:1788658314.551125:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658314.551131:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:3650:x1875544025108096:12345-0@lo:103: 00010000:00010000:1.0:1788658314.551142:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658314.551158:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80031600/0x48e67cc629c6e757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e750 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658314.551172:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658314.551205:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:3650:x1875544025108096:12345-0@lo:103: Request processed in 74us (4116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.551212:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658314.551240:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025108096:0@lo:103: 00000100:00100000:3.0:1788658314.551521:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108480:0@lo:502: 00000040:00080000:3.0:1788658314.551797:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788658314.551829:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788658314.551841:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788658314.551852:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788658314.551864:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788658314.551876:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788658314.551904:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108608:0@lo:502: 00000100:00100000:3.0:1788658314.551964:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658314.552000:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658314.552121:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025108608 00000100:00100000:1.0:1788658314.552133:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025108608 00000100:00100000:1.0:1788658314.552158:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788658314.552165:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:9528:x1875544025108608:12345-0@lo:502: 00000100:00100000:1.0:1788658314.552251:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:9528:x1875544025108608:12345-0@lo:502: Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.552258:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788658314.552387:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108608:0@lo:502: 00000040:00080000:3.0:1788658314.552423:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788658314.552430:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:1.0:1788658314.552835:0:9540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788658314.552844:0:9540:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788658314.552851:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658314.552853:0:9540:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788658314.552859:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658314.552881:0:9540:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a1d82778000) 00000020:00000080:1.0:1788658314.552903:0:9540:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788658314.552909:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788658314.553059:0:9540:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d8230c000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788658314.553068:0:9540:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788658314.553074:0:9540:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x48e67cc629c6e773 00010000:00010000:1.0:1788658314.561621:0:9540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1788658314.562141:0:9540:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788658314.565879:0:9540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788658314.568076:0:9540:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788658314.571641:0:9540:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788658314.571869:0:9540:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788658314.576977:0:9540:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788658314.578117:0:9540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788658314.578128:0:9540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658314.578134:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658314.578137:0:9540:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788658314.578140:0:9540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658314.578144:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658314.578145:0:9540:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658314.578148:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658314.578150:0:9540:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788658314.578172:0:9540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658314.578175:0:9540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658314.578176:0:9540:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788658314.578179:0:9540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788658314.578693:0:9528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788658314.579058:0:9528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788658314.579084:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.579098:0:9528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658314.579115:0:9528:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d8230c000 from 1 10000000:01000000:3.0:1788658314.579118:0:9528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658314.579160:0:9528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.579169:0:9528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.579182:0:9528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.579206:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108736:0@lo:101: 00000100:00100000:3.0:1788658314.579279:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658314.579327:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d82478600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658314.580726:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025108736 00000100:00100000:2.0:1788658314.581548:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025108736 00000100:00100000:2.0:1788658314.581618:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788658314.581630:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:9528:x1875544025108736:12345-0@lo:101: 00010000:00010000:2.0:1788658314.581646:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658314.581668:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e781 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e77a expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.581697:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e77a expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.583079:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e77a expref: 16 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.583091:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390200, rc 0) 00000100:00100000:2.0:1788658314.583185:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108736:12345-0@lo:101: Request processed in 1556us (3904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658314.583192:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788658314.583294:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108736:0@lo:101: 00010000:00010000:0.0:1788658314.583316:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.583326:0:9528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658314.583478:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108864:0@lo:501: 00000100:00100000:0.0:1788658314.583518:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.583599:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658314.588448:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025108864 00000100:00100000:1.0:1788658314.588464:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025108864 00000100:00100000:1.0:1788658314.588572:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788658314.588583:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108864:12345-0@lo:501: 00000100:00100000:1.0:1788658314.588809:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108864:12345-0@lo:501: Request processed in 228us (5290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.588826:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788658314.589881:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108864:0@lo:501: 00000100:00100000:0.0:1788658314.590529:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108992:0@lo:503: 00000100:00100000:0.0:1788658314.590601:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.592569:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658314.595169:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025108992 00000100:00100000:2.0:1788658314.595184:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025108992 00000100:00100000:3.0:1788658314.595490:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788658314.595503:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108992:12345-0@lo:503: 00000100:00100000:3.0:1788658314.595686:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025108992:12345-0@lo:503: Request processed in 185us (5084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.595694:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788658314.596000:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025108992:0@lo:503: 00000040:00080000:0.0:1788658314.596262:0:9528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658314.596546:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109120:0@lo:502: 00000100:00100000:0.0:1788658314.596587:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.596645:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658314.596689:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025109120 00000100:00100000:3.0:1788658314.596696:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025109120 00000100:00100000:3.0:1788658314.596865:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788658314.596874:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025109120:12345-0@lo:502: 00000100:00100000:3.0:1788658314.597086:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025109120:12345-0@lo:502: Request processed in 212us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.597092:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788658314.597140:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109120:0@lo:502: 00000040:00080000:0.0:1788658314.597496:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788658314.597519:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788658314.597539:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109248:0@lo:502: 00000100:00100000:0.0:1788658314.597568:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.597618:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658314.597653:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025109248 00000100:00100000:3.0:1788658314.597664:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025109248 00000100:00100000:3.0:1788658314.597827:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788658314.597837:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025109248:12345-0@lo:502: 00000100:00100000:3.0:1788658314.598039:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025109248:12345-0@lo:502: Request processed in 204us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.598044:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788658314.598091:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109248:0@lo:502: 00000040:00080000:0.0:1788658314.598122:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788658314.598127:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788658314.598643:0:9544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658314.598651:0:9544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658314.598653:0:9544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788658314.598667:0:9544:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1d8230c000 00000020:00000080:0.0:1788658314.598669:0:9544:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788658314.598685:0:9544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658314.598688:0:9544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658314.598689:0:9544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788658314.598691:0:9544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788658314.598885:0:9528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788658314.598912:0:9528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658314.598925:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.598938:0:9528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658314.599010:0:9528:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788658314.599013:0:9528:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1d8230c000 10000000:01000000:2.0:1788658314.599027:0:9528:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1d8230c000 10000000:01000000:2.0:1788658314.599032:0:9528:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658314.599038:0:9528:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1d8230c000 from 1 10000000:01000000:2.0:1788658314.599040:0:9528:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788658314.599065:0:9528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.599072:0:9528:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.599087:0:9528:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658314.599100:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109376:0@lo:101: 00000100:00100000:2.0:1788658314.599131:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658314.599160:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658314.599165:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025109376 00000100:00100000:3.0:1788658314.599171:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025109376 00000100:00100000:3.0:1788658314.599209:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788658314.599216:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9528:x1875544025109376:12345-0@lo:101: 00010000:00010000:3.0:1788658314.599226:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658314.599240:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e78f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e788 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.599261:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e788 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.599272:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e788 expref: 17 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.599280:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670600, rc 0) 00000100:00100000:3.0:1788658314.599448:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025109376:12345-0@lo:101: Request processed in 231us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.599455:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788658314.599471:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109376:0@lo:101: 00010000:00010000:2.0:1788658314.599484:0:9528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.599493:0:9528:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658314.599569:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109504:0@lo:501: 00000100:00100000:2.0:1788658314.599587:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658314.599603:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658314.599619:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025109504 00000100:00100000:3.0:1788658314.599622:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025109504 00000100:00100000:3.0:1788658314.599651:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788658314.599657:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025109504:12345-0@lo:501: 00000100:00100000:3.0:1788658314.599884:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025109504:12345-0@lo:501: Request processed in 226us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658314.600056:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109504:0@lo:501: 00000100:00100000:2.0:1788658314.600086:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109632:0@lo:503: 00000100:00100000:2.0:1788658314.600123:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658314.600161:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658314.600285:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788658314.600379:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025109632 00000100:00100000:3.0:1788658314.600431:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025109632 00000100:00100000:3.0:1788658314.600456:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788658314.600463:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025109632:12345-0@lo:503: 00000100:00100000:3.0:1788658314.600546:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025109632:12345-0@lo:503: Request processed in 83us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.600553:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788658314.600568:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109632:0@lo:503: 00000040:00080000:2.0:1788658314.600848:0:9528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658314.600903:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109760:0@lo:502: 00000100:00100000:2.0:1788658314.600935:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658314.600977:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658314.601139:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025109760 00000100:00100000:1.0:1788658314.601144:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025109760 00000100:00100000:1.0:1788658314.601172:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788658314.601177:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025109760:12345-0@lo:502: 00000100:00100000:1.0:1788658314.601255:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025109760:12345-0@lo:502: Request processed in 77us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.601262:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788658314.601280:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109760:0@lo:502: 00000040:00080000:2.0:1788658314.601470:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788658314.601498:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788658314.601514:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788658314.601530:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788658314.601543:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788658314.601552:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788658314.601559:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788658314.601566:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788658314.601573:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788658314.601580:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788658314.601588:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788658314.601595:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788658314.601602:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788658314.601609:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788658314.601616:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788658314.601622:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788658314.601629:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788658314.601636:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788658314.601642:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788658314.601649:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788658314.601668:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788658314.601677:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788658314.601684:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788658314.601691:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788658314.601699:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788658314.601745:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788658314.601759:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788658314.601771:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788658314.601783:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788658314.601813:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788658314.601828:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788658314.601850:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788658314.601864:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788658314.601877:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788658314.601887:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788658314.601896:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788658314.601906:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788658314.601930:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788658314.601944:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788658314.601956:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788658314.601980:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788658314.601996:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788658314.602008:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788658314.602079:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788658314.602102:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788658314.602115:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788658314.602146:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109888:0@lo:502: 00000100:00100000:0.0:1788658314.602194:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.602268:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658314.602490:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025109888 00000100:00100000:3.0:1788658314.602497:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025109888 00000100:00100000:3.0:1788658314.602541:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788658314.602549:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025109888:12345-0@lo:502: 00000100:00100000:3.0:1788658314.602693:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025109888:12345-0@lo:502: Request processed in 144us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.602724:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788658314.602938:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025109888:0@lo:502: 00000040:00080000:0.0:1788658314.602985:0:9528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788658314.602994:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788658314.603507:0:9545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788658314.603519:0:9545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a1eb23f3380) 00000020:00000080:0.0:1788658314.603538:0:9545:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788658314.603619:0:9545:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d8230c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788658314.603622:0:9545:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1d8230c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788658314.603624:0:9545:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1d8230c000 3 00010000:00080000:0.0:1788658314.603649:0:9545:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1ebdc0a000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1788658314.607163:0:9545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788658314.608045:0:9545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788658314.608098:0:9545:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788658314.608114:0:9545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x48e67cc629c6e79d 00000100:00080000:0.0:1788658314.608125:0:9545:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658314.608131:0:9545:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a1ebdc0a000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658314.608171:0:9545:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb377e680 x1875544025110016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658314.608258:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025110016:0@lo:38: 00000100:00100000:1.0:1788658314.610515:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658314.610573:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025110016 00000100:00100000:2.0:1788658314.610583:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025110016 00000100:00100000:2.0:1788658314.610648:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658314.610917:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025110016:12345-0@lo:38: 00010000:00080000:2.0:1788658314.610950:0:6537:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:2.0:1788658314.610993:0:6537:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x48e67cc629c6e7a4 00000004:00100000:2.0:1788658314.611009:0:6537:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788658314.611054:0:6537:0:(import.c:65:import_set_state_nolock()) ffff8a1d82763800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788658314.611154:0:9545:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788658314.611269:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025110528:0@lo:400: 00000100:00100000:0.0:1788658314.611324:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.611349:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025111040:0@lo:400: 00000100:00100000:0.0:1788658314.611401:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.611428:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788658314.611435:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025110144:0@lo:400: 00000100:00100000:0.0:1788658314.611469:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.611488:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025110656:0@lo:400: 00000100:00100000:0.0:1788658314.611510:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.611537:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025110272:0@lo:400: 00000100:00100000:0.0:1788658314.613255:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.613293:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025110784:0@lo:400: 00000100:00100000:0.0:1788658314.613325:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.613342:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788658314.613347:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025110400:0@lo:400: 00000100:00100000:0.0:1788658314.613362:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.613370:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025110912:0@lo:400: 00000100:00100000:0.0:1788658314.613397:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.613439:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025110528 00000100:00100000:0.0:1788658314.613445:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025110528 00000100:00100000:0.0:1788658314.613479:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025110272 00000100:00100000:0.0:1788658314.613480:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025110272 00000100:00100000:0.0:1788658314.613490:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788658314.613496:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025110528:12345-0@lo:400: 00000100:00100000:0.0:1788658314.613548:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025110528:12345-0@lo:400: Request processed in 52us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.613554:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788658314.613568:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788658314.613572:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025110272:12345-0@lo:400: 00000100:00100000:0.0:1788658314.613588:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025110272:12345-0@lo:400: Request processed in 17us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.613591:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788658314.613603:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025111040 00000100:00100000:0.0:1788658314.613605:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025111040 00000100:00100000:0.0:1788658314.613627:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025110912 00000100:00100000:0.0:1788658314.613628:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025110912 00000100:00100000:0.0:1788658314.613637:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658314.613640:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025111040:12345-0@lo:400: 00000100:00100000:0.0:1788658314.613664:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025111040:12345-0@lo:400: Request processed in 23us (2263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.613670:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658314.613680:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658314.613685:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025110912:12345-0@lo:400: 00000100:00100000:0.0:1788658314.613728:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025110912:12345-0@lo:400: Request processed in 43us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.613734:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658314.613753:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025110144 00000100:00100000:0.0:1788658314.613756:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025110144 00000100:00100000:0.0:1788658314.613773:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025110656 00000100:00100000:0.0:1788658314.613776:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025110656 00000100:00100000:0.0:1788658314.615127:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025110784 00000100:00100000:0.0:1788658314.615136:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025110784 00000100:00100000:0.0:1788658314.615182:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025110400 00000100:00100000:0.0:1788658314.615186:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025110400 00000100:00100000:0.0:1788658314.615200:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658314.615209:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025110144:12345-0@lo:400: 00000100:00100000:0.0:1788658314.615265:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025110144:12345-0@lo:400: Request processed in 58us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.615272:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658314.615287:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658314.615292:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025110656:12345-0@lo:400: 00000100:00100000:0.0:1788658314.615316:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025110656:12345-0@lo:400: Request processed in 25us (3806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.615322:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658314.615332:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658314.615339:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025110784:12345-0@lo:400: 00000100:00100000:0.0:1788658314.615383:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025110784:12345-0@lo:400: Request processed in 45us (2057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.615389:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658314.615401:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788658314.615408:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025110400:12345-0@lo:400: 00000100:00100000:0.0:1788658314.615434:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025110400:12345-0@lo:400: Request processed in 28us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.615440:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788658314.615468:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658314.615472:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658314.615475:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788658314.615512:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb377e300 x1875544025110400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658314.615541:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025110400:0@lo:400: 00010000:00080000:0.0:1788658314.615556:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb377ea00 x1875544025110912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658314.615565:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025110912:0@lo:400: 00000100:00100000:0.0:1788658314.615575:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025110272:0@lo:400: 00010000:00080000:0.0:1788658314.615585:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb377d180 x1875544025110784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658314.615592:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025110784:0@lo:400: 00010000:00080000:0.0:1788658314.615629:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb377c380 x1875544025110144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658314.615644:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025110144:0@lo:400: 00010000:00080000:0.0:1788658314.615673:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb377f480 x1875544025110656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658314.615681:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025110656:0@lo:400: 00000100:00100000:0.0:1788658314.615692:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025110528:0@lo:400: 00010000:00080000:0.0:1788658314.615725:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb377c700 x1875544025111040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658314.615733:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025111040:0@lo:400: 00000100:00100000:2.0:1788658314.620611:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875544025110016:12345-0@lo:38: Request processed in 9684us (10088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658314.620626:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788658314.620964:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb377e680 x1875544025110016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658314.620976:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658314.620988:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788658314.620996:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788658314.621001:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788658314.621004:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc0a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788658314.621011:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025110016:0@lo:38: 00000020:01000004:0.0:1788658314.621415:0:9545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788658314.621432:0:9545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a1eb23f19c0) 00000020:00000080:0.0:1788658314.621457:0:9545:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788658314.621559:0:9545:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1d8230c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788658314.621563:0:9545:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1d8230c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788658314.621566:0:9545:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1d8230c000 3 00010000:00080000:0.0:1788658314.621596:0:9545:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1ebdc08000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.153@tcp at head 00000100:00100000:1.0:1788658314.624692:0:9546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eec000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9546:1875544025111168:0@lo:901: 00000100:00100000:1.0:1788658314.624802:0:9546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658314.624854:0:9546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb23c56c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788658314.625743:0:9545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788658314.626286:0:9545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788658314.627037:0:9545:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788658314.627055:0:9545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x48e67cc629c6e7b2 00000100:00080000:2.0:1788658314.627065:0:9545:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658314.627072:0:9545:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a1ebdc08000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658314.627109:0:9545:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1e84432a00 x1875544025111296/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658314.627141:0:9545:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788658314.627817:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025111168 00000100:00100000:3.0:1788658314.627827:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025111168 00000100:00100000:3.0:1788658314.627890:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658314.627899:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9546:x1875544025111168:12345-0@lo:901: 00000100:00100000:3.0:1788658314.628068:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9546:x1875544025111168:12345-0@lo:901: Request processed in 169us (3265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.628076:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788658314.630076:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788658314.630101:0:9546:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb5eec000 x1875544025111168/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788658330 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658314.630259:0:9546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eec000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9546:1875544025111168:0@lo:901: 00000100:00100000:0.0:1788658314.630641:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875544025111296:0@lo:38: 00000100:00100000:0.0:1788658314.630727:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.630789:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025111296 00000100:00100000:0.0:1788658314.630795:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025111296 00000100:00100000:0.0:1788658314.630827:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658314.630834:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875544025111296:12345-0@lo:38: 00010000:00080000:0.0:1788658314.630861:0:6536:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:0.0:1788658314.630897:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x48e67cc629c6e7b9 00000004:00100000:0.0:1788658314.630925:0:6536:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788658314.630960:0:6536:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc08800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658314.631006:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875544025111296:12345-0@lo:38: Request processed in 171us (278us total) trans 0 rc 0/0 00000040:00080000:2.0:1788658314.631010:0:9545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:0.0:1788658314.631013:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788658314.631056:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1e84432a00 x1875544025111296/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658314.631065:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788658314.631071:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788658314.631078:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788658314.631083:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788658314.631085:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc08000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788658314.631091:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875544025111296:0@lo:38: 00000020:01000000:2.0:1788658314.631105:0:9528:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788658314.631136:0:9528:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788658314.638468:0:9528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658314.638488:0:9528:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788658314.638563:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788658314.638565:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658314.638567:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658314.638568:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658314.638569:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658314.638571:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658314.638572:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658314.638574:0:9528:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658314.638575:0:9528:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658314.638577:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658314.638578:0:9528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658314.638583:0:9528:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788658314.638585:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658314.638586:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658314.638587:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658314.638588:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658314.638589:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658314.638590:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658314.638591:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658314.638592:0:9528:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658314.638593:0:9528:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658314.638594:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658314.638595:0:9528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658314.638621:0:9528:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788658314.640262:0:9528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025111424:0@lo:253: 00000100:00100000:2.0:1788658314.640353:0:9528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658314.640400:0:9528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658314.640426:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025111424 00000100:00100000:3.0:1788658314.640434:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025111424 00000100:00100000:3.0:1788658314.640493:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788658314.640503:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025111424:12345-0@lo:253: 20000000:01000000:3.0:1788658314.640550:0:6531:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788658314.640565:0:6531:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788658314.650050:0:6531:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788658314.650124:0:6531:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788658314.650656:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9528:x1875544025111424:12345-0@lo:253: Request processed in 10149us (10297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658314.650669:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788658314.651061:0:9528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9528:1875544025111424:0@lo:253: 10000000:01000000:2.0:1788658314.651076:0:9528:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788658314.651081:0:9528:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658314.651083:0:9528:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658314.651084:0:9528:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658314.651085:0:9528:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658314.651086:0:9528:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658314.651088:0:9528:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658314.651089:0:9528:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658314.651090:0:9528:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788658314.651091:0:9528:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788658314.651093:0:9528:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658314.651094:0:9528:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788658314.651189:0:9528:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788658314.653235:0:6552:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788658314.653245:0:6552:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788658314.653278:0:6552:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.653298:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e80030400/0x48e67cc629c6e6b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e6af expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.654482:0:6552:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e6fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e6f5 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.654491:0:6552:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.654543:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e6f5 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.654560:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e6fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e6f5 expref: 16 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.654575:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025111552:0@lo:104: 00000100:00100000:3.0:1788658314.654641:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658314.654798:0:6552:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e80030400/0x48e67cc629c6e6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e6af expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.654807:0:6552:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e80030400/0x48e67cc629c6e6b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e6af expref: 16 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.654817:0:6552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025111680:0@lo:104: 00000100:00100000:3.0:1788658314.654859:0:6552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:2.0:1788658314.662016:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788658314.662439:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788658314.662640:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00000100:00100000:3.0:1788658314.663014:0:6552:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e91185240 going to sleep for 11 seconds 00080000:10000000:2.0:1788658314.663254:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788658314.663595:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788658314.664078:0:9528:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1788658314.664264:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025111552 00000100:00100000:0.0:1788658314.664275:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025111552 00000100:00100000:0.0:1788658314.664385:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025111680 00000100:00100000:0.0:1788658314.664389:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025111680 00000100:00100000:0.0:1788658314.664410:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658314.664420:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6552:x1875544025111552:12345-0@lo:104: 00010000:00010000:0.0:1788658314.664443:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.664551:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658314.664557:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:6552:x1875544025111552:12345-0@lo:104: Request processed in 139us (9917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.664564:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658314.664567:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025111552:0@lo:104: 00000100:00100000:0.0:1788658314.664582:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788658314.664588:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6552:x1875544025111680:12345-0@lo:104: 00010000:00010000:0.0:1788658314.664596:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.664633:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788658314.664650:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:6552:x1875544025111680:12345-0@lo:104: Request processed in 51us (9779us total) trans 0 rc 0/0 00010000:00010000:3.0:1788658314.664844:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658314.664851:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.664859:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658314.664864:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.664873:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658314.664880:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658314.664886:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1788658314.664892:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788658314.664919:0:6552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6552:1875544025111680:0@lo:104: 00010000:00010000:3.0:1788658314.664933:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.664939:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658314.664943:0:6552:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.664957:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.664957:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658314.664961:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.664964:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e6f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6fc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.664977:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658314.664978:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391400 already unused, calling callback (ffffffffc116ac20) 00010000:00010000:3.0:1788658314.664979:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658314.664980:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1788658314.664988:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.664995:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658314.665001:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658314.665007:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658314.665031:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.665037:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658314.665050:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.665056:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391400/0x48e67cc629c6e6af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e6b6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.665068:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658314.665070:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658314.665071:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658314.665088:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025111936:0@lo:103: 00000100:00100000:0.0:1788658314.665123:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.665162:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025111936 00000100:00100000:0.0:1788658314.665166:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025111936 00000100:00100000:3.0:1788658314.665185:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025111808:0@lo:103: 00010000:00010000:0.0:1788658314.665195:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e80030400/0x48e67cc629c6e6b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e6af expref: 17 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.665215:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658314.665217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658314.665230:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3647:x1875544025111936:12345-0@lo:103: 00010000:00010000:0.0:1788658314.665240:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658314.665245:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e80030400/0x48e67cc629c6e6b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e6af expref: 17 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.665254:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e80030400/0x48e67cc629c6e6b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e6af expref: 17 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658314.665257:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025111808 00000100:00100000:3.0:1788658314.665260:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025111808 00010000:00010000:0.0:1788658314.665268:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80030400/0x48e67cc629c6e6b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e6af expref: 18 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665273:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e6fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e6f5 expref: 18 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658314.665279:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658314.665292:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658314.665298:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3650:x1875544025111808:12345-0@lo:103: 00010000:00010000:3.0:1788658314.665562:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658314.665567:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e6fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e6f5 expref: 17 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665576:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e6fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e6f5 expref: 17 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665587:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d1a00/0x48e67cc629c6e6fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e6f5 expref: 17 pid: 6531 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665599:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665607:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658314.665609:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:3647:x1875544025111936:12345-0@lo:103: Request processed in 380us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658314.665616:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 20000000:01000000:3.0:1788658314.665621:0:6521:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012376898s 00010000:00010000:3.0:1788658314.665625:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665632:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665649:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665655:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665661:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658314.665665:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665672:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665686:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.665695:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658314.665944:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025111936:0@lo:103: 00000001:00000004:2.0:1788658314.666750:0:9528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788658314.667618:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:3650:x1875544025111808:12345-0@lo:103: Request processed in 2315us (2396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658314.667629:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788658314.667665:0:6552:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.667676:0:6552:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658314.667683:0:6552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6552 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658314.667969:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025111808:0@lo:103: 00002000:00080000:2.0:1788658314.681527:0:9528:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788658314.681538:0:9528:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788658314.681603:0:9528:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788658314.681655:0:9528:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788658314.681676:0:9528:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788658314.681698:0:9528:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788658314.683684:0:9528:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658314.684532:0:9528:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788658314.699890:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788658315.695967:0:9601:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658315.696218:0:9601:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788658315.713621:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025112064:0@lo:41: 00000100:00100000:1.0:1788658315.713692:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658315.713798:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025112064 00000100:00100000:1.0:1788658315.713806:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025112064 00000100:00100000:1.0:1788658315.713999:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658315.714010:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025112064:12345-0@lo:41: 00000004:00000024:1.0:1788658315.714047:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788658315.714108:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025112064:12345-0@lo:41: Request processed in 100us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658315.714117:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658315.714405:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025112064:0@lo:41: 00010000:00010000:3.0:1788658315.726911:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658316.737381:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658317.759654:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658317.759684:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025112192:0@lo:13: 00000100:00100000:1.0:1788658317.759771:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658317.760233:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658317.760442:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025112192 00000100:00100000:0.0:1788658317.760451:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025112192 00000100:00080000:3.0:1788658317.760504:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658317.760518:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658317.761084:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025112192:12345-0@lo:13: 00002000:00000024:0.0:1788658317.761129:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658317.761199:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025112192:12345-0@lo:13: Request processed in 120us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658317.763187:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788658317.763267:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d832e5c00 x1875544025112192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658317.763291:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025112192:0@lo:13: 00000100:00100000:0.0:1788658317.763920:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025112320:0@lo:13: 00000100:00100000:0.0:1788658317.763982:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658317.764107:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025112320 00000100:00100000:3.0:1788658317.764124:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025112320 00000100:00100000:3.0:1788658317.764188:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658317.764197:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025112320:12345-0@lo:13: 00002000:00000024:3.0:1788658317.764216:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658317.764386:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025112320:12345-0@lo:13: Request processed in 190us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658317.764393:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788658317.764481:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788658317.764532:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e84430e00 x1875544025112320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658317.764547:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025112320:0@lo:13: 00000100:00100000:0.0:1788658318.271412:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025112448:0@lo:41: 00000100:00100000:0.0:1788658318.271562:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658318.277483:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025112448 00000100:00100000:3.0:1788658318.277501:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025112448 00000100:00100000:3.0:1788658318.277611:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658318.277623:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025112448:12345-0@lo:41: 00000004:00000024:3.0:1788658318.277661:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788658318.277790:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025112448:12345-0@lo:41: Request processed in 169us (6228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658318.277797:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788658318.277903:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025112448:0@lo:41: 00010000:00010000:1.0:1788658318.797440:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658319.806993:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025112576:0@lo:400: 00000100:00100000:2.0:1788658319.807067:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658319.807109:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025112576 00000100:00100000:1.0:1788658319.807119:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025112576 00000100:00100000:2.0:1788658319.807133:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025113088:0@lo:400: 00000100:00100000:2.0:1788658319.807160:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658319.807193:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025113600:0@lo:400: 00000100:00100000:1.0:1788658319.807198:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788658319.807211:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:3648:x1875544025112576:12345-0@lo:400: 00000100:00100000:2.0:1788658319.807225:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658319.807248:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788658319.807255:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025112960:0@lo:400: 00000100:00100000:1.0:1788658319.807270:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:3648:x1875544025112576:12345-0@lo:400: Request processed in 62us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.807284:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658319.807288:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788658319.807319:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025113472:0@lo:400: 00000100:00100000:2.0:1788658319.807342:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658319.807373:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025112576:0@lo:400: 00000100:00100000:2.0:1788658319.807398:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025113088 00000100:00100000:2.0:1788658319.807402:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025113088 00000100:00100000:2.0:1788658319.807671:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658319.807681:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025113088:12345-0@lo:400: 00000100:00100000:2.0:1788658319.807812:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025113088:12345-0@lo:400: Request processed in 133us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.807818:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658319.807842:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025113600 00000100:00100000:2.0:1788658319.807846:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025113600 00000100:00100000:2.0:1788658319.807889:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025113472 00000100:00100000:2.0:1788658319.807892:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025113472 00000100:00100000:2.0:1788658319.807906:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658319.807912:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025113600:12345-0@lo:400: 00000100:00080000:1.0:1788658319.807932:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658319.808080:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025112704:0@lo:400: 00000100:00100000:0.0:1788658319.808145:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025112832:0@lo:400: 00000100:00100000:3.0:1788658319.809367:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.809374:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.809409:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025113344:0@lo:400: 00000100:00100000:3.0:1788658319.809448:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025113216:0@lo:400: 00000100:00100000:0.0:1788658319.809448:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658319.809499:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025113600:12345-0@lo:400: Request processed in 1585us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.809518:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658319.809540:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658319.809550:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025113472:12345-0@lo:400: 00000100:00100000:1.0:1788658319.812970:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025112960 00000100:00100000:1.0:1788658319.812987:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025112960 00000100:00100000:1.0:1788658319.813058:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025112704 00000100:00100000:1.0:1788658319.813062:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025112704 00000100:00100000:3.0:1788658319.813129:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658319.813195:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025113728:0@lo:400: 00000100:00100000:2.0:1788658319.813218:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025113472:12345-0@lo:400: Request processed in 3666us (5870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.813231:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658319.813266:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658319.813277:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025113344 00000100:00100000:2.0:1788658319.813283:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025113344 00000100:00100000:2.0:1788658319.813320:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025113216 00000100:00100000:2.0:1788658319.813323:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025113216 00000100:00100000:2.0:1788658319.813338:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025113728 00000100:00100000:2.0:1788658319.813340:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025113728 00000100:00100000:2.0:1788658319.813355:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658319.813360:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025112832 00000100:00100000:2.0:1788658319.813365:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025112960:12345-0@lo:400: 00000100:00100000:3.0:1788658319.813367:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025112832 00000100:00100000:3.0:1788658319.813401:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788658319.813413:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025112832:12345-0@lo:400: 00000100:00100000:2.0:1788658319.813420:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025112960:12345-0@lo:400: Request processed in 56us (6135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.813427:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658319.813443:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658319.813451:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025113344:12345-0@lo:400: 00000100:00100000:2.0:1788658319.813486:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025113344:12345-0@lo:400: Request processed in 36us (4039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.813492:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658319.813501:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658319.813506:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025113216:12345-0@lo:400: 00000100:00100000:2.0:1788658319.813534:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025113216:12345-0@lo:400: Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.813549:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658319.813560:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658319.813566:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025113728:12345-0@lo:400: 00000100:00100000:2.0:1788658319.813591:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025113728:12345-0@lo:400: Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658319.813596:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788658319.813815:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658319.813819:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788658319.813847:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef4380 x1875544025112960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658319.813860:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025112960:0@lo:400: 00010000:00080000:2.0:1788658319.813873:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef6a00 x1875544025113472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658319.813883:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025113472:0@lo:400: 00000100:00100000:2.0:1788658319.813895:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025113088:0@lo:400: 00010000:00080000:2.0:1788658319.813911:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef5180 x1875544025113600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658319.813920:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025113600:0@lo:400: 00000100:00100000:1.0:1788658319.813948:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788658319.813957:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025112704:12345-0@lo:400: 00000100:00100000:1.0:1788658319.813994:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025112704:12345-0@lo:400: Request processed in 39us (4631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658319.814000:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788658319.814191:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788658319.814248:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef4000 x1875544025113344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658319.814258:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025113344:0@lo:400: 00000100:00100000:0.0:1788658319.814267:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025113856:0@lo:400: 00000100:00100000:0.0:1788658319.814293:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658319.814334:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025112832:0@lo:400: 00000100:00100000:0.0:1788658319.814353:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025113856 00000100:00100000:0.0:1788658319.814357:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025113856 00000100:00100000:3.0:1788658319.814386:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025112832:12345-0@lo:400: Request processed in 53us (4090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658319.814397:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788658319.814398:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788658319.814409:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025113856:12345-0@lo:400: 00010000:00080000:3.0:1788658319.814437:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eec700 x1875544025112704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658319.814449:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025112704:0@lo:400: 00000100:00100000:0.0:1788658319.814453:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025113856:12345-0@lo:400: Request processed in 44us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658319.814469:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788658319.814502:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef5f80 x1875544025113856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658319.814511:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025113856:0@lo:400: 00000100:00080000:2.0:1788658319.814589:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788658319.814657:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef7100 x1875544025113216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658319.814667:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025113216:0@lo:400: 00010000:00080000:3.0:1788658319.814901:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef6300 x1875544025113728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658319.814915:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025113728:0@lo:400: 00000100:00100000:1.0:1788658320.830910:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025113984:0@lo:41: 00000100:00100000:1.0:1788658320.830982:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658320.831060:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025113984 00000100:00100000:1.0:1788658320.831070:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025113984 00000100:00100000:1.0:1788658320.831114:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658320.831124:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025113984:12345-0@lo:41: 00000004:00000024:1.0:1788658320.831156:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788658320.831197:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025113984:12345-0@lo:41: Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658320.831204:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658320.831267:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025113984:0@lo:41: 00010000:00010000:3.0:1788658320.831627:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658321.232917:0:9891:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788658321.860406:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788658322.038156:0:9943:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658322.038410:0:9943:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788658322.368354:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788658322.368361:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ebd8b1800 from 39 10000000:01000000:0.0:1788658322.368367:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658322.368413:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.368426:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.368437:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658322.368461:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025114112:0@lo:101: 00000100:00100000:0.0:1788658322.368532:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.368594:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.368946:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025114112 00000100:00100000:3.0:1788658322.368955:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025114112 00000100:00100000:3.0:1788658322.369009:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788658322.369018:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025114112:12345-0@lo:101: 00010000:00010000:3.0:1788658322.369031:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658322.369045:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e7ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e7c7 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.369089:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e7c7 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.369282:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e7c7 expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.369292:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671000, rc 0) 00000100:00100000:3.0:1788658322.369345:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025114112:12345-0@lo:101: Request processed in 328us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.369352:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788658322.370440:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025114112:0@lo:101: 00010000:00010000:0.0:1788658322.370463:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.370475:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658322.370555:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025114240:0@lo:501: 00000100:00100000:0.0:1788658322.370608:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.370684:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658322.373863:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025114240 00000100:00100000:2.0:1788658322.373891:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025114240 00000100:00100000:3.0:1788658322.374223:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788658322.374235:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025114240:12345-0@lo:501: 00000100:00100000:3.0:1788658322.374424:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025114240:12345-0@lo:501: Request processed in 190us (3814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.374431:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788658322.376861:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025114240:0@lo:501: 00000100:00100000:0.0:1788658322.377041:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025114368:0@lo:503: 00000100:00100000:0.0:1788658322.377185:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.377272:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.379219:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025114368 00000100:00100000:3.0:1788658322.379233:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025114368 00000100:00100000:3.0:1788658322.379347:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788658322.379358:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025114368:12345-0@lo:503: 00000100:00100000:3.0:1788658322.379528:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025114368:12345-0@lo:503: Request processed in 171us (2343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.379536:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788658322.379624:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025114368:0@lo:503: 00000100:00100000:0.0:1788658322.379862:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9963:1875544025114496:0@lo:502: 00000100:00100000:0.0:1788658322.379917:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.381529:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658322.381687:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025114496 00000100:00100000:2.0:1788658322.381696:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025114496 00000100:00100000:2.0:1788658322.381761:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788658322.381770:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9963:x1875544025114496:12345-0@lo:502: 00000100:00100000:2.0:1788658322.382051:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9963:x1875544025114496:12345-0@lo:502: Request processed in 281us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658322.382059:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788658322.382181:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9963:1875544025114496:0@lo:502: 00000100:00100000:0.0:1788658322.382246:0:9963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9963:1875544025114624:0@lo:502: 00000100:00100000:0.0:1788658322.382297:0:9963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.382313:0:9963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658322.382402:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025114624 00000100:00100000:0.0:1788658322.382406:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025114624 00000100:00100000:0.0:1788658322.382425:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788658322.382431:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9963:x1875544025114624:12345-0@lo:502: 00000100:00100000:0.0:1788658322.382511:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:9963:x1875544025114624:12345-0@lo:502: Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.382517:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788658322.382589:0:9963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9963:1875544025114624:0@lo:502: 00000040:00080000:2.0:1788658322.382610:0:9963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788658322.382801:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788658322.382822:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788658322.382833:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.382853:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658322.382864:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788658322.382866:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788658322.382871:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788658322.382970:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.382979:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.382988:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658322.383001:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025114752:0@lo:101: 00000100:00100000:0.0:1788658322.383345:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.383377:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658322.383427:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025114752 00000100:00100000:2.0:1788658322.383432:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025114752 00000100:00100000:2.0:1788658322.383456:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788658322.383463:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025114752:12345-0@lo:101: 00010000:00010000:2.0:1788658322.383472:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658322.383485:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c6e7dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e7d5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658322.383507:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c6e7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e7d5 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658322.383516:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c6e7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e7d5 expref: 17 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658322.383525:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391c00, rc 0) 00000100:00100000:2.0:1788658322.383601:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025114752:12345-0@lo:101: Request processed in 138us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658322.383608:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788658322.384058:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025114752:0@lo:101: 00010000:00010000:0.0:1788658322.384073:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.384082:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658322.384296:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025114880:0@lo:501: 00000100:00100000:1.0:1788658322.384329:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.384388:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658322.384434:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025114880 00000100:00100000:2.0:1788658322.384444:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025114880 00000100:00100000:2.0:1788658322.384507:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788658322.384515:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025114880:12345-0@lo:501: 00000100:00100000:2.0:1788658322.384638:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025114880:12345-0@lo:501: Request processed in 124us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658322.384645:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788658322.384724:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025114880:0@lo:501: 00000100:00100000:1.0:1788658322.384749:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025115008:0@lo:503: 00000100:00100000:1.0:1788658322.384786:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.385057:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.385190:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025115008 00000100:00100000:3.0:1788658322.385195:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025115008 00000100:00100000:3.0:1788658322.385219:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788658322.385226:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025115008:12345-0@lo:503: 00000100:00100000:3.0:1788658322.385343:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025115008:12345-0@lo:503: Request processed in 117us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.385350:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788658322.385436:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025115008:0@lo:503: 00000100:00100000:1.0:1788658322.385781:0:9964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9964:1875544025115136:0@lo:502: 00000100:00100000:1.0:1788658322.385818:0:9964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.385836:0:9964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.386001:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025115136 00000100:00100000:3.0:1788658322.386005:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025115136 00000100:00100000:3.0:1788658322.386024:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788658322.386030:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9964:x1875544025115136:12345-0@lo:502: 00000100:00100000:3.0:1788658322.386213:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9964:x1875544025115136:12345-0@lo:502: Request processed in 182us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.386220:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788658322.386480:0:9964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9964:1875544025115136:0@lo:502: 00000020:01000000:1.0:1788658322.386512:0:9964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658322.386520:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658322.386523:0:9964:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788658322.386527:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788658322.386529:0:9964:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788658322.386545:0:9964:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9964:1875544025115264:0@lo:502: 00000100:00100000:1.0:1788658322.386578:0:9964:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.386636:0:9964:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecfd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.386670:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025115264 00000100:00100000:3.0:1788658322.386673:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025115264 00000100:00100000:3.0:1788658322.386805:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788658322.386813:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9964:x1875544025115264:12345-0@lo:502: 00000100:00100000:3.0:1788658322.386878:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:9964:x1875544025115264:12345-0@lo:502: Request processed in 66us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.386885:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788658322.386995:0:9964:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9964:1875544025115264:0@lo:502: 00000020:01000000:1.0:1788658322.387012:0:9964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658322.387017:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658322.387019:0:9964:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788658322.387022:0:9964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788658322.387172:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788658322.387193:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788658322.387203:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.387220:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658322.387229:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788658322.387232:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ec11f4800 from 39 10000000:01000000:0.0:1788658322.387235:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658322.387269:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.387277:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.387286:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658322.387300:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025115392:0@lo:101: 00000100:00100000:0.0:1788658322.387328:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.387465:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.387523:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025115392 00000100:00100000:3.0:1788658322.387528:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025115392 00000100:00100000:3.0:1788658322.387546:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788658322.387552:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025115392:12345-0@lo:101: 00010000:00010000:3.0:1788658322.387561:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658322.387572:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e7e3 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.387592:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e7e3 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.387613:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e7e3 expref: 18 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.387621:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670c00, rc 0) 00000100:00100000:3.0:1788658322.387659:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025115392:12345-0@lo:101: Request processed in 106us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.387665:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788658322.387743:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025115392:0@lo:101: 00010000:00010000:0.0:1788658322.387756:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.387766:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658322.387815:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025115520:0@lo:501: 00000100:00100000:0.0:1788658322.387839:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.387865:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.387981:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025115520 00000100:00100000:3.0:1788658322.387985:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025115520 00000100:00100000:3.0:1788658322.388003:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788658322.388009:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025115520:12345-0@lo:501: 00000100:00100000:3.0:1788658322.388254:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025115520:12345-0@lo:501: Request processed in 244us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.388272:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788658322.388419:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025115520:0@lo:501: 00000100:00100000:0.0:1788658322.388446:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025115648:0@lo:503: 00000100:00100000:0.0:1788658322.388486:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.388535:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658322.388548:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025115648 00000100:00100000:0.0:1788658322.388553:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025115648 00000100:00100000:3.0:1788658322.388595:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788658322.388602:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025115648:12345-0@lo:503: 00000100:00100000:3.0:1788658322.388680:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025115648:12345-0@lo:503: Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.388687:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788658322.388869:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025115648:0@lo:503: 00000100:00100000:2.0:1788658322.389291:0:9965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9965:1875544025115776:0@lo:502: 00000100:00100000:2.0:1788658322.389328:0:9965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658322.389359:0:9965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3476840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658322.389397:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025115776 00000100:00100000:1.0:1788658322.389402:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025115776 00000100:00100000:1.0:1788658322.389436:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788658322.389443:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:9965:x1875544025115776:12345-0@lo:502: 00000100:00100000:1.0:1788658322.389542:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:9965:x1875544025115776:12345-0@lo:502: Request processed in 99us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658322.389550:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788658322.389614:0:9965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9965:1875544025115776:0@lo:502: 00000100:00100000:2.0:1788658322.389655:0:9965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9965:1875544025115904:0@lo:502: 00000100:00100000:2.0:1788658322.389686:0:9965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658322.389729:0:9965:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f2600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658322.389777:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025115904 00000100:00100000:1.0:1788658322.389781:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025115904 00000100:00100000:1.0:1788658322.389798:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788658322.389803:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:9965:x1875544025115904:12345-0@lo:502: 00000100:00100000:1.0:1788658322.389870:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:9965:x1875544025115904:12345-0@lo:502: Request processed in 65us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658322.389877:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788658322.389983:0:9965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9965:1875544025115904:0@lo:502: 00000040:00080000:2.0:1788658322.390001:0:9965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788658322.390187:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788658322.390208:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788658322.390217:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658322.390227:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658322.390237:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788658322.390240:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ec11f4800 from 6 10000000:01000000:1.0:1788658322.390242:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788658322.390275:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658322.390284:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658322.390293:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658322.390316:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025116032:0@lo:101: 00000100:00100000:1.0:1788658322.390341:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.390363:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658322.390404:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025116032 00000100:00100000:2.0:1788658322.390408:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025116032 00000100:00100000:2.0:1788658322.390426:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788658322.390432:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025116032:12345-0@lo:101: 00010000:00010000:2.0:1788658322.390441:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658322.390452:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e7f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e7f1 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658322.390471:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e7f1 expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658322.390480:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e7f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e7f1 expref: 19 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658322.390494:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390000, rc 0) 00000100:00100000:2.0:1788658322.390529:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025116032:12345-0@lo:101: Request processed in 97us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658322.390536:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788658322.390593:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025116032:0@lo:101: 00010000:00010000:1.0:1788658322.390604:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658322.390613:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658322.390652:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025116160:0@lo:256: 00000100:00100000:1.0:1788658322.390679:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.390754:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.390825:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025116160 00000100:00100000:3.0:1788658322.390829:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025116160 00000100:00100000:3.0:1788658322.390850:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788658322.390856:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025116160:12345-0@lo:256: 20000000:01000000:3.0:1788658322.390869:0:6531:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788658322.390886:0:6531:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788658322.390889:0:6531:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788658322.390981:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025116160:12345-0@lo:256: Request processed in 125us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.390988:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788658322.391018:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025116160:0@lo:256: 10000000:01000000:3.0:1788658322.391057:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658322.391062:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.391070:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658322.391076:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788658322.391078:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1788658322.391080:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788658322.391221:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.391229:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.391237:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658322.391250:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025116288:0@lo:101: 00000100:00100000:3.0:1788658322.391284:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.391305:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.391318:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025116288 00000100:00100000:3.0:1788658322.391322:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025116288 00000100:00100000:3.0:1788658322.391337:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788658322.391342:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025116288:12345-0@lo:101: 00010000:00010000:3.0:1788658322.391352:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658322.391361:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6e806 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e7ff expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.391375:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6e806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e7ff expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.391383:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6e806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e7ff expref: 20 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.391390:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670e00, rc 0) 00000100:00100000:3.0:1788658322.391413:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025116288:12345-0@lo:101: Request processed in 71us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.391419:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788658322.391441:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025116288:0@lo:101: 00010000:00010000:3.0:1788658322.391451:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.391459:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658322.391512:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025116416:0@lo:501: 00000100:00100000:3.0:1788658322.391534:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.391547:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.391557:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025116416 00000100:00100000:3.0:1788658322.391559:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025116416 00000100:00100000:3.0:1788658322.391577:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788658322.391582:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025116416:12345-0@lo:501: 00000100:00100000:3.0:1788658322.391690:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025116416:12345-0@lo:501: Request processed in 106us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.391696:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788658322.391762:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025116416:0@lo:501: 00000100:00100000:3.0:1788658322.391787:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025116544:0@lo:503: 00000100:00100000:3.0:1788658322.391824:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.391838:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.391849:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025116544 00000100:00100000:3.0:1788658322.391852:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025116544 00000100:00100000:3.0:1788658322.391868:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788658322.391874:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025116544:12345-0@lo:503: 00000100:00100000:3.0:1788658322.392013:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025116544:12345-0@lo:503: Request processed in 139us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.392020:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788658322.392055:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025116544:0@lo:503: 00000100:00100000:3.0:1788658322.392334:0:9966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9966:1875544025116672:0@lo:502: 00000100:00100000:3.0:1788658322.392367:0:9966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.392386:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025116672 00000100:00100000:3.0:1788658322.392390:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025116672 00000100:00100000:3.0:1788658322.392406:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788658322.392413:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:9966:x1875544025116672:12345-0@lo:502: 00000100:00100000:3.0:1788658322.392477:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:9966:x1875544025116672:12345-0@lo:502: Request processed in 63us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.392484:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788658322.392510:0:9966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.392525:0:9966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9966:1875544025116672:0@lo:502: 00000020:01000000:3.0:1788658322.392545:0:9966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788658322.392551:0:9966:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788658322.392558:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658322.392560:0:9966:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788658322.392566:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788658322.392570:0:9966:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:3.0:1788658322.392590:0:9966:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788658322.392593:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658322.392607:0:9966:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a1d821b99c0) 00000020:00000080:3.0:1788658322.392628:0:9966:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788658322.392633:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788658322.392740:0:9966:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788658322.392747:0:9966:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788658322.392757:0:9966:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6e814 00010000:00080000:3.0:1788658322.392800:0:9966:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb7411800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658322.393389:0:9966:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788658322.393518:0:9966:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788658322.393530:0:9966:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788658322.393686:0:9966:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658322.394062:0:9966:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658322.394420:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788658322.394528:0:9966:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788658322.395026:0:9967:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658322.395030:0:9967:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788658322.395764:0:9966:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788658322.395776:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788658322.395816:0:9966:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788658322.395840:0:9966:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6e81b 00000100:00080000:3.0:1788658322.395851:0:9966:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658322.395857:0:9966:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1eb7411800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658322.395891:0:9966:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d8275e680 x1875544025116800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658322.396180:0:9966:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788658322.396317:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025116928:0@lo:400: 00000100:00100000:3.0:1788658322.396394:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.396425:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025117440:0@lo:400: 00000100:00100000:3.0:1788658322.396447:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.396461:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025117952:0@lo:400: 00000100:00100000:3.0:1788658322.396479:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.396502:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788658322.396507:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025117312:0@lo:400: 00000100:00100000:3.0:1788658322.396532:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.396551:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025117824:0@lo:400: 00000100:00100000:3.0:1788658322.396573:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.396602:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025117056:0@lo:400: 00000100:00100000:3.0:1788658322.396624:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.396640:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025117568:0@lo:400: 00000100:00100000:3.0:1788658322.396659:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.396674:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025118080:0@lo:400: 00000100:00100000:3.0:1788658322.396697:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.396729:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788658322.396735:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025117184:0@lo:400: 00000100:00100000:3.0:1788658322.396755:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.396764:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025117696:0@lo:400: 00000100:00100000:3.0:1788658322.396784:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.396812:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025117312 00000100:00100000:3.0:1788658322.396824:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025117312 00000100:00100000:3.0:1788658322.396864:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025117056 00000100:00100000:3.0:1788658322.396867:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025117056 00000100:00100000:3.0:1788658322.396883:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788658322.396891:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025117312:12345-0@lo:400: 00000100:00100000:0.0:1788658322.397018:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025116800:0@lo:8: 00000100:00100000:0.0:1788658322.397050:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.397089:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025116928 00000100:00100000:0.0:1788658322.397093:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025116928 00000100:00100000:0.0:1788658322.397124:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025117440 00000100:00100000:0.0:1788658322.397127:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025117440 00000100:00100000:0.0:1788658322.397147:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025117952 00000100:00100000:0.0:1788658322.397149:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025117952 00000100:00100000:0.0:1788658322.397160:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025117568 00000100:00100000:0.0:1788658322.397162:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025117568 00000100:00100000:0.0:1788658322.397172:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025118080 00000100:00100000:0.0:1788658322.397174:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025118080 00000100:00100000:0.0:1788658322.397185:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025117184 00000100:00100000:0.0:1788658322.397187:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025117184 00000100:00100000:0.0:1788658322.397199:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788658322.397204:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025116928:12345-0@lo:400: 00000100:00100000:0.0:1788658322.397252:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025116928:12345-0@lo:400: Request processed in 47us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.397271:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788658322.397287:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658322.397293:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025117440:12345-0@lo:400: 00000100:00100000:0.0:1788658322.397319:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025117440:12345-0@lo:400: Request processed in 27us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.397331:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658322.397342:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788658322.397348:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025117952:12345-0@lo:400: 00000100:00100000:0.0:1788658322.397372:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025117952:12345-0@lo:400: Request processed in 24us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.397377:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788658322.397387:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788658322.397392:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025117568:12345-0@lo:400: 00000100:00100000:0.0:1788658322.397419:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025117568:12345-0@lo:400: Request processed in 27us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.397425:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788658322.397434:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788658322.397440:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025118080:12345-0@lo:400: 00000100:00100000:0.0:1788658322.397466:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025118080:12345-0@lo:400: Request processed in 26us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.397471:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788658322.397481:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788658322.397486:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025117184:12345-0@lo:400: 00000100:00100000:0.0:1788658322.397509:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025117184:12345-0@lo:400: Request processed in 23us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.397515:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788658322.397532:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658322.397535:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788658322.397571:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275dc00 x1875544025117184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658322.397599:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025117184:0@lo:400: 00010000:00080000:0.0:1788658322.397612:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275e300 x1875544025117568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658322.397619:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025117568:0@lo:400: 00010000:00080000:0.0:1788658322.397628:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275d180 x1875544025118080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658322.397635:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025118080:0@lo:400: 00010000:00080000:0.0:1788658322.397666:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275fb80 x1875544025116928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658322.397674:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025116928:0@lo:400: 00010000:00080000:0.0:1788658322.397682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275df80 x1875544025117440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658322.397688:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025117440:0@lo:400: 00010000:00080000:0.0:1788658322.397736:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275ea00 x1875544025117952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658322.397746:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025117952:0@lo:400: 00000100:00100000:3.0:1788658322.398002:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025117312:12345-0@lo:400: Request processed in 1111us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.398009:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788658322.398025:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788658322.398032:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025117056:12345-0@lo:400: 00000100:00100000:3.0:1788658322.398063:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025117056:12345-0@lo:400: Request processed in 33us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.398068:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000020:01000000:3.0:1788658322.398440:0:9966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658322.398447:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658322.398450:0:9966:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788658322.398453:0:9966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658322.398456:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658322.398458:0:9966:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788658322.398461:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788658322.398462:0:9966:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788658322.398496:0:9966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9966:1875544025118208:0@lo:502: 00000100:00100000:3.0:1788658322.398549:0:9966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.398573:0:9966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658322.400465:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025117056:0@lo:400: 00000100:00100000:0.0:1788658322.400509:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025117312:0@lo:400: 00000100:00100000:0.0:1788658322.400535:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025118208 00000100:00100000:0.0:1788658322.400542:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025118208 00000100:00100000:0.0:1788658322.400607:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788658322.400629:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:9966:x1875544025118208:12345-0@lo:502: 00000100:00100000:0.0:1788658322.400836:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:9966:x1875544025118208:12345-0@lo:502: Request processed in 207us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.400846:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788658322.401603:0:9966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9966:1875544025118208:0@lo:502: 00000020:01000000:3.0:1788658322.401640:0:9966:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658322.401649:0:9966:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658322.401651:0:9966:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788658322.401656:0:9966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:2.0:1788658322.401941:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025117824 00000100:00100000:2.0:1788658322.401948:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025117824 00000100:00100000:2.0:1788658322.401994:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025117696 00000100:00100000:2.0:1788658322.401998:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025117696 00000100:00100000:2.0:1788658322.402011:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025116800 00000100:00100000:2.0:1788658322.402014:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025116800 00000100:00100000:2.0:1788658322.402026:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658322.402033:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025117824:12345-0@lo:400: 00000100:00080000:3.0:1788658322.402226:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658322.402253:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025117824:12345-0@lo:400: Request processed in 220us (5678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658322.402268:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658322.402284:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658322.402291:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025117696:12345-0@lo:400: 00000100:00100000:2.0:1788658322.402337:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025117696:12345-0@lo:400: Request processed in 47us (5551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658322.402343:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658322.402354:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658322.402359:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875544025116800:12345-0@lo:8: 00010000:00080000:2.0:1788658322.402384:0:8452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1788658322.402414:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6e822 00002000:00100000:2.0:1788658322.402428:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a1d82763000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788658322.402442:0:8452:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788658322.402446:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788658322.402506:0:8452:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788658322.402760:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788658322.402784:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8a1d82764000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658322.402827:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875544025116800:12345-0@lo:8: Request processed in 466us (5775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658322.402833:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788658322.402878:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275e680 x1875544025116800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658322.402890:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00010000:00080000:3.0:1788658322.403008:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275c000 x1875544025117696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658322.403019:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025117696:0@lo:400: 00000100:00080000:2.0:1788658322.403064:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788658322.403072:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788658322.403079:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788658322.403081:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7411800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000020:01000000:0.0:1788658322.403141:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788658322.403166:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788658322.403176:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.403187:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658322.403198:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788658322.403201:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ec1212800 from 39 10000000:01000000:0.0:1788658322.403204:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658322.403235:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.403244:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658322.403253:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658322.403279:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025118336:0@lo:101: 00000100:00100000:0.0:1788658322.403319:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.403359:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5240 going to sleep for 11 seconds 00010000:00080000:0.0:1788658322.403387:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275f480 x1875544025117824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658322.403413:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025117824:0@lo:400: 00000100:00100000:3.0:1788658322.403540:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025118336 00000100:00100000:3.0:1788658322.403547:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025118336 00000100:00100000:3.0:1788658322.403587:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788658322.403594:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025118336:12345-0@lo:101: 00010000:00010000:3.0:1788658322.403604:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658322.403630:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96600/0x48e67cc629c6e830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e829 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.403656:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96600/0x48e67cc629c6e830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e829 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.403668:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96600/0x48e67cc629c6e830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e829 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.403677:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96600, rc 0) 00000100:00100000:3.0:1788658322.403741:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025118336:12345-0@lo:101: Request processed in 147us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.403748:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788658322.403782:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025118336:0@lo:101: 00010000:00010000:3.0:1788658322.403795:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.403803:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658322.403869:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025118464:0@lo:501: 00000100:00100000:3.0:1788658322.403907:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.403928:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aa180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.403939:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025118464 00000100:00100000:3.0:1788658322.403942:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025118464 00000100:00100000:3.0:1788658322.403965:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788658322.403972:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025118464:12345-0@lo:501: 00000100:00100000:3.0:1788658322.404077:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025118464:12345-0@lo:501: Request processed in 104us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.404085:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788658322.404122:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025118464:0@lo:501: 00000100:00100000:3.0:1788658322.404148:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025118592:0@lo:503: 00000100:00100000:3.0:1788658322.404187:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.404198:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aa180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.404209:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025118592 00000100:00100000:3.0:1788658322.404212:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025118592 00000100:00100000:3.0:1788658322.404227:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788658322.404232:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025118592:12345-0@lo:503: 00000100:00100000:3.0:1788658322.404314:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025118592:12345-0@lo:503: Request processed in 82us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.404321:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788658322.404354:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025118592:0@lo:503: 00000100:00100000:3.0:1788658322.404523:0:9969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9969:1875544025118720:0@lo:502: 00000100:00100000:3.0:1788658322.404554:0:9969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.404577:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025118720 00000100:00100000:3.0:1788658322.404580:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025118720 00000100:00100000:3.0:1788658322.404599:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788658322.404605:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:9969:x1875544025118720:12345-0@lo:502: 00000100:00100000:3.0:1788658322.404666:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:9969:x1875544025118720:12345-0@lo:502: Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.404672:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788658322.404697:0:9969:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.404735:0:9969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9969:1875544025118720:0@lo:502: 00000100:00100000:3.0:1788658322.404771:0:9969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9969:1875544025118848:0@lo:502: 00000100:00100000:3.0:1788658322.404802:0:9969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.404819:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025118848 00000100:00100000:3.0:1788658322.404822:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025118848 00000100:00100000:3.0:1788658322.404840:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788658322.404846:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:9969:x1875544025118848:12345-0@lo:502: 00000100:00100000:3.0:1788658322.404896:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:9969:x1875544025118848:12345-0@lo:502: Request processed in 50us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.404903:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788658322.404931:0:9969:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.404942:0:9969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9969:1875544025118848:0@lo:502: 00000040:00080000:3.0:1788658322.404958:0:9969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788658322.404997:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788658322.405013:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788658322.405020:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405029:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658322.405042:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658322.405044:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1ec1212800 from 6 10000000:01000000:3.0:1788658322.405047:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658322.405064:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405071:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405079:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658322.405090:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025118976:0@lo:101: 00000100:00100000:3.0:1788658322.405113:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.405126:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.405135:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025118976 00000100:00100000:3.0:1788658322.405138:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025118976 00000100:00100000:3.0:1788658322.405156:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788658322.405161:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025118976:12345-0@lo:101: 00010000:00010000:3.0:1788658322.405168:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658322.405177:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b97e00/0x48e67cc629c6e83e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e837 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405191:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b97e00/0x48e67cc629c6e83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e837 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405200:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b97e00/0x48e67cc629c6e83e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e837 expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405217:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97e00, rc 0) 00000100:00100000:3.0:1788658322.405243:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025118976:12345-0@lo:101: Request processed in 82us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.405248:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788658322.405288:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025118976:0@lo:101: 00010000:00010000:3.0:1788658322.405300:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405307:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658322.405348:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025119104:0@lo:256: 00000100:00100000:3.0:1788658322.405375:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.405387:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.405397:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025119104 00000100:00100000:3.0:1788658322.405400:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025119104 00000100:00100000:3.0:1788658322.405420:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788658322.405425:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025119104:12345-0@lo:256: 20000000:01000000:3.0:1788658322.405436:0:6531:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788658322.405454:0:6531:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788658322.405457:0:6531:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788658322.405524:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025119104:12345-0@lo:256: Request processed in 99us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.405531:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788658322.405557:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025119104:0@lo:256: 10000000:01000000:3.0:1788658322.405593:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658322.405602:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405610:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658322.405617:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788658322.405618:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788658322.405620:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788658322.405633:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405640:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405647:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658322.405658:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025119232:0@lo:101: 00000100:00100000:3.0:1788658322.405682:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.405694:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.405726:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025119232 00000100:00100000:3.0:1788658322.405730:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025119232 00000100:00100000:3.0:1788658322.405750:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788658322.405756:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025119232:12345-0@lo:101: 00010000:00010000:3.0:1788658322.405762:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658322.405769:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b97c00/0x48e67cc629c6e84c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e845 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405784:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b97c00/0x48e67cc629c6e84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e845 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405798:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b97c00/0x48e67cc629c6e84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e845 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405805:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97c00, rc 0) 00000100:00100000:3.0:1788658322.405830:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025119232:12345-0@lo:101: Request processed in 75us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.405835:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788658322.405863:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025119232:0@lo:101: 00010000:00010000:3.0:1788658322.405873:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.405880:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658322.405917:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025119360:0@lo:501: 00000100:00100000:3.0:1788658322.405940:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.405956:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2169c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.405966:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025119360 00000100:00100000:3.0:1788658322.405968:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025119360 00000100:00100000:3.0:1788658322.405988:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788658322.405993:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025119360:12345-0@lo:501: 00000100:00100000:3.0:1788658322.406065:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025119360:12345-0@lo:501: Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.406072:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788658322.406098:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025119360:0@lo:501: 00000100:00100000:3.0:1788658322.406122:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025119488:0@lo:503: 00000100:00100000:3.0:1788658322.406162:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.406175:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2169c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.406185:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025119488 00000100:00100000:3.0:1788658322.406188:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025119488 00000100:00100000:3.0:1788658322.406206:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788658322.406212:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025119488:12345-0@lo:503: 00000100:00100000:3.0:1788658322.406293:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025119488:12345-0@lo:503: Request processed in 80us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.406299:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788658322.406333:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025119488:0@lo:503: 00000100:00100000:1.0:1788658322.406883:0:9968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1875544025119616:0@lo:700: 00000100:00100000:1.0:1788658322.407020:0:9968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.407046:0:9968:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658322.407151:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025119616 00000100:00100000:0.0:1788658322.407156:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025119616 00000100:00100000:0.0:1788658322.407206:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658322.407215:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9968:x1875544025119616:12345-0@lo:700: 00000100:00100000:0.0:1788658322.407244:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8461:1875544025119744:0@lo:700: 00000100:00100000:0.0:1788658322.407284:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.407302:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5e40 going to sleep for 11 seconds 00000100:00080000:1.0:1788658322.407501:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788658322.407698:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788658322.407724:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025116800:0@lo:8: 00000004:00080000:1.0:1788658322.407873:0:9967:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788658322.407952:0:9967:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 239624247889ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788658322.407958:0:9967:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788658322.408436:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025119744 00000100:00100000:0.0:1788658322.408441:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025119744 00000100:00100000:0.0:1788658322.408483:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658322.408491:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8461:x1875544025119744:12345-0@lo:700: 00000100:00100000:0.0:1788658322.408651:0:9970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9970:1875544025119872:0@lo:502: 00000100:00100000:0.0:1788658322.408728:0:9970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.408765:0:9970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.408842:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025119872 00000100:00100000:3.0:1788658322.408847:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025119872 00000100:00100000:3.0:1788658322.408892:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788658322.408901:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:9970:x1875544025119872:12345-0@lo:502: 00000100:00100000:3.0:1788658322.409020:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:9970:x1875544025119872:12345-0@lo:502: Request processed in 120us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.409029:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788658322.409210:0:9970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9970:1875544025119872:0@lo:502: 00000020:01000000:1.0:1788658322.409235:0:9970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788658322.409242:0:9970:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788658322.409249:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658322.409267:0:9970:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788658322.409274:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788658322.409278:0:9970:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:1.0:1788658322.409299:0:9970:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788658322.409301:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658322.409317:0:9970:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a1d8277b380) 00000020:00000080:1.0:1788658322.409339:0:9970:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788658322.409344:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788658322.409429:0:9970:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788658322.409435:0:9970:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788658322.409443:0:9970:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6e85a 00010000:00080000:1.0:1788658322.409472:0:9970:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb7448800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1788658322.409774:0:9970:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788658322.409877:0:9970:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788658322.409888:0:9970:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788658322.412725:0:9970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658322.413343:0:9970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658322.413457:0:9970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788658322.413529:0:9970:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:0.0:1788658322.413926:0:7466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000040:00080000:2.0:1788658322.414177:0:9971:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658322.414182:0:9971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788658322.415196:0:9970:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788658322.415211:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788658322.415254:0:9970:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788658322.415295:0:9970:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6e861 00000100:00080000:0.0:1788658322.415305:0:9970:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658322.415311:0:9970:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1eb7448800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658322.415348:0:9970:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d832e6300 x1875544025120000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658322.415430:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025120000:0@lo:8: 00000100:00100000:2.0:1788658322.415516:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 40000000:02000000:1.0:1788658322.415690:0:6543:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1788658322.415765:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025120000 00000100:00100000:3.0:1788658322.415773:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025120000 00000100:00100000:3.0:1788658322.415808:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658322.415817:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875544025120000:12345-0@lo:8: 00010000:00080000:3.0:1788658322.415845:0:8452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1788658322.415873:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6e868 00002000:00100000:3.0:1788658322.415887:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a1eb7411000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788658322.415891:0:8452:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788658322.415894:0:8452:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788658322.415968:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788658322.415991:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7412800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788658322.418348:0:9970:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788658322.418483:0:9970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658322.418490:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658322.418491:0:9970:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788658322.418496:0:9970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658322.418500:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658322.418501:0:9970:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788658322.418504:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788658322.418506:0:9970:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788658322.418545:0:9970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9970:1875544025120128:0@lo:502: 00000100:00100000:0.0:1788658322.418620:0:9970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.418659:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025120128 00000100:00100000:0.0:1788658322.418665:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025120128 00000100:00100000:0.0:1788658322.418721:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788658322.418730:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:9970:x1875544025120128:12345-0@lo:502: 00000100:00100000:0.0:1788658322.418840:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:9970:x1875544025120128:12345-0@lo:502: Request processed in 110us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.418860:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788658322.419658:0:9970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658322.419688:0:9970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:9970:1875544025120128:0@lo:502: 00000020:01000000:0.0:1788658322.419742:0:9970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658322.419749:0:9970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658322.419752:0:9970:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788658322.419758:0:9970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00010000:00080000:0.0:1788658322.421681:0:8461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d832e6d80 x1875544025119744/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788658338 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658322.421698:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8461:1875544025119744:0@lo:700: 40000000:02000000:0.0:1788658322.421724:0:8461:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1788658322.422629:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8461:x1875544025119744:12345-0@lo:700: Request processed in 13120us (14325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658322.422656:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658322.430578:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875544025120000:12345-0@lo:8: Request processed in 14747us (15048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.430595:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:3.0:1788658322.430692:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1788658322.430748:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788658322.430761:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.430773:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658322.430784:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788658322.430786:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1eae393380 from 1 10000000:01000000:3.0:1788658322.430789:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788658322.430823:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.430831:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.430840:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658322.430859:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025120256:0@lo:101: 00000100:00100000:3.0:1788658322.430922:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.430962:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aa180 going to sleep for 11 seconds 00000100:00100000:1.0:1788658322.431009:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025120256 00000100:00100000:1.0:1788658322.431016:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025120256 00000100:00100000:1.0:1788658322.431061:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788658322.431069:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025120256:12345-0@lo:101: 00010000:00010000:1.0:1788658322.431081:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658322.431094:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c6e876 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e86f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658322.431144:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c6e876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e86f expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658322.431155:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c6e876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e86f expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658322.431163:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b3000, rc 0) 00000100:00100000:1.0:1788658322.431208:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025120256:12345-0@lo:101: Request processed in 140us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658322.431214:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:2.0:1788658322.431882:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d832e6300 x1875544025120000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658322.431894:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658322.431978:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788658322.431989:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788658322.432005:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788658322.432009:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7448800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788658322.432072:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788658322.432079:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025120000:0@lo:8: 00000004:00080000:1.0:1788658322.432782:0:9971:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788658322.432971:0:9971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 239649266841ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788658322.432981:0:9971:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788658322.433053:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025120256:0@lo:101: 00010000:00010000:3.0:1788658322.433076:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.433097:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658322.433177:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025120384:0@lo:501: 00000100:00100000:3.0:1788658322.433229:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1788658322.434821:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788658322.434830:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788658322.434940:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9968:x1875544025119616:12345-0@lo:700: Request processed in 27723us (27916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658322.434953:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:1.0:1788658322.434984:0:9972:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788658322.435009:0:9972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9972:1875544025120640:0@lo:7: 00000100:00100000:1.0:1788658322.435048:0:9972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.435072:0:9972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecfe40 going to sleep for 11 seconds 00010000:00080000:2.0:1788658322.435089:0:9968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef4a80 x1875544025119616/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788658338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658322.435176:0:9968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1875544025119616:0@lo:700: 00000100:00100000:2.0:1788658322.435290:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025120640 00000100:00100000:2.0:1788658322.435296:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025120640 00000100:00100000:2.0:1788658322.435352:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658322.435361:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9972:x1875544025120640:12345-0@lo:7: 00000100:00080000:1.0:1788658322.435778:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658322.435884:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025120512:0@lo:13: 00000100:00100000:1.0:1788658322.435924:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.436188:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aa180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.436274:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025120512 00000100:00100000:3.0:1788658322.436280:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025120512 00000100:00100000:3.0:1788658322.436374:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658322.436384:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025120512:12345-0@lo:13: 00002000:00000024:3.0:1788658322.436408:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923931136 avail 3692408832 00000100:00100000:3.0:1788658322.436460:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025120512:12345-0@lo:13: Request processed in 79us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.436466:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788658322.436998:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025120384 00000100:00100000:0.0:1788658322.437009:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025120384 00000100:00100000:0.0:1788658322.437045:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788658322.437053:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025120384:12345-0@lo:501: 00000100:00100000:0.0:1788658322.437206:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025120384:12345-0@lo:501: Request processed in 153us (3976us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788658322.437214:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00080000:0.0:1788658322.437793:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef7100 x1875544025120512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658322.437814:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025120512:0@lo:13: 00000100:00100000:3.0:1788658322.439274:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025120384:0@lo:501: 10000000:01000000:3.0:1788658322.439412:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788658322.439424:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658322.439435:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788658322.443328:0:8454:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788658322.443340:0:8454:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788658322.443427:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9972:x1875544025120640:12345-0@lo:7: Request processed in 8062us (8375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658322.443438:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788658322.444969:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef5f80 x1875544025120640/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788658338 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658322.445014:0:9972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9972:1875544025120640:0@lo:7: 00000004:00080000:1.0:1788658322.445029:0:9972:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788658322.445071:0:9972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9972:1875544025120768:0@lo:5: 00000100:00100000:1.0:1788658322.445136:0:9972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.445182:0:9972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658322.445422:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025120768 00000100:00100000:2.0:1788658322.445429:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025120768 00000100:00100000:2.0:1788658322.445484:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658322.445494:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9972:x1875544025120768:12345-0@lo:5: 00002000:00080000:2.0:1788658322.445521:0:8453:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788658322.445525:0:8453:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788658322.445924:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9972:x1875544025120768:12345-0@lo:5: Request processed in 430us (787us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788658322.445933:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788658322.445948:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef5f80 x1875544025120768/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658338 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658322.445959:0:9972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9972:1875544025120768:0@lo:5: 00000004:00080000:3.0:1788658322.445972:0:9972:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788658322.445994:0:9972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9972:1875544025120896:0@lo:700: 00000100:00100000:3.0:1788658322.446017:0:9972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.446038:0:9972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834aa180 going to sleep for 11 seconds 00000004:00080000:0.0:1788658322.446755:0:9968:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788658322.446776:0:9968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1875544025121152:0@lo:7: 00000100:00100000:0.0:1788658322.446810:0:9968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.446835:0:9968:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658322.446848:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658322.446857:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025121024:0@lo:13: 00000100:00100000:0.0:1788658322.446881:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658322.446919:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025121024 00000100:00100000:0.0:1788658322.446924:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025121024 00000100:00100000:0.0:1788658322.446956:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658322.446963:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025121024:12345-0@lo:13: 00002000:00000024:0.0:1788658322.446978:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923931136 avail 3692408832 00000100:00100000:0.0:1788658322.447018:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025121024:12345-0@lo:13: Request processed in 55us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.447025:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788658322.447057:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275e680 x1875544025121024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658322.447085:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025121024:0@lo:13: 00000100:00100000:2.0:1788658322.447335:0:8460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025120896 00000100:00100000:2.0:1788658322.447340:0:8460:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025120896 00000100:00100000:2.0:1788658322.447415:0:8460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658322.447429:0:8460:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9972:x1875544025120896:12345-0@lo:700: 00000100:00100000:2.0:1788658322.450663:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025121152 00000100:00100000:2.0:1788658322.450677:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025121152 00000100:00100000:2.0:1788658322.450762:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658322.450772:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9968:x1875544025121152:12345-0@lo:7: 00000004:00080000:2.0:1788658322.452070:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00080000:2.0:1788658322.464360:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1788658322.464522:0:8460:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9972:x1875544025120896:12345-0@lo:700: Request processed in 17090us (18499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658322.464535:0:8460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788658322.464669:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e98368a80 x1875544025120896/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788658338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658322.464682:0:9972:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788658322.464698:0:9972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9972:1875544025120896:0@lo:700: 00000004:02000040:0.0:1788658322.465921:0:9972:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00002000:00080000:1.0:1788658322.474221:0:8454:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788658322.474231:0:8454:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788658322.474345:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9968:x1875544025121152:12345-0@lo:7: Request processed in 23569us (27528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658322.474356:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788658322.474507:0:9968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275f480 x1875544025121152/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788658338 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658322.474522:0:9968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1875544025121152:0@lo:7: 00000004:00080000:2.0:1788658322.474536:0:9968:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788658322.474588:0:9968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84433480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1875544025121280:0@lo:5: 00000100:00100000:2.0:1788658322.474627:0:9968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658322.474681:0:9968:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82a893c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.474750:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025121280 00000100:00100000:3.0:1788658322.474757:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025121280 00000100:00100000:3.0:1788658322.474802:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658322.474811:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9968:x1875544025121280:12345-0@lo:5: 00002000:00080000:3.0:1788658322.474836:0:8452:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788658322.474877:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9968:x1875544025121280:12345-0@lo:5: Request processed in 67us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658322.474883:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788658322.475084:0:9968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e84433480 x1875544025121280/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658338 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658322.475094:0:9968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84433480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1875544025121280:0@lo:5: 00000004:00080000:1.0:1788658322.475174:0:9968:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788658322.475201:0:9968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1875544025121408:0@lo:5: 00000100:00100000:1.0:1788658322.475227:0:9968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.475298:0:9968:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf240 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.475362:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025121408 00000100:00100000:3.0:1788658322.475367:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025121408 00000100:00100000:3.0:1788658322.475426:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658322.475434:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9968:x1875544025121408:12345-0@lo:5: 00002000:00080000:3.0:1788658322.475459:0:8454:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1788658322.477870:0:9972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9972:1875544025121536:0@lo:5: 00000100:00100000:1.0:1788658322.477936:0:9972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.478976:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9968:x1875544025121408:12345-0@lo:5: Request processed in 3539us (3744us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788658322.478987:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658322.479948:0:9972:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf3c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788658322.480128:0:9968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef6d80 x1875544025121408/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658322.480145:0:9968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9968:1875544025121408:0@lo:5: 00000004:00080000:3.0:1788658322.480159:0:9968:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788658322.480198:0:9968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9968:1875544025121664:0@lo:900: 00000100:00100000:3.0:1788658322.480257:0:9968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.480300:0:9968:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2169c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658322.480315:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025121536 00000100:00100000:3.0:1788658322.480323:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025121536 00000100:00100000:3.0:1788658322.480359:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658322.480367:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9972:x1875544025121536:12345-0@lo:5: 00000100:00100000:1.0:1788658322.480681:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025121664 00000100:00100000:1.0:1788658322.480686:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025121664 00000100:00100000:1.0:1788658322.480738:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658322.480745:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9968:x1875544025121664:12345-0@lo:900: 00000100:00100000:1.0:1788658322.480798:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9968:x1875544025121664:12345-0@lo:900: Request processed in 53us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658322.480812:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788658322.480936:0:9968:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e98368e00 x1875544025121664/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788658338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658322.480947:0:9968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9968:1875544025121664:0@lo:900: 00002000:00080000:3.0:1788658322.485529:0:8454:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788658322.485620:0:8454:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788658322.487529:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9972:x1875544025121536:12345-0@lo:5: Request processed in 7157us (9587us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788658322.487541:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788658322.487659:0:9972:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef4380 x1875544025121536/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658322.487676:0:9972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9972:1875544025121536:0@lo:5: 00000004:00080000:1.0:1788658322.487689:0:9972:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1788658322.879929:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658322.880016:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658322.880040:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025121792:0@lo:13: 00000100:00100000:3.0:1788658322.880111:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658322.880341:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025121920:0@lo:13: 00000100:00100000:3.0:1788658322.880369:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658322.880439:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025121792 00000100:00100000:1.0:1788658322.880447:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025121792 00000100:00100000:1.0:1788658322.880487:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025121920 00000100:00100000:1.0:1788658322.880490:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025121920 00000100:00100000:1.0:1788658322.880505:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658322.880514:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025121792:12345-0@lo:13: 00002000:00000024:1.0:1788658322.880543:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658322.880607:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025121792:12345-0@lo:13: Request processed in 94us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658322.880614:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658322.880628:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658322.880634:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025121920:12345-0@lo:13: 00002000:00000024:1.0:1788658322.880642:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658322.880666:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025121920:12345-0@lo:13: Request processed in 33us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658322.880671:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788658322.880725:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef7100 x1875544025121920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658322.880742:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025121920:0@lo:13: 00010000:00080000:3.0:1788658322.880874:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e98368e00 x1875544025121792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658322.880886:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025121792:0@lo:13: 00000001:00080000:0.0:1788658322.945650:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1788658322.945668:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788658323.391551:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025122048:0@lo:41: 00000100:00100000:1.0:1788658323.391668:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658323.391853:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025122048 00000100:00100000:2.0:1788658323.391861:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025122048 00000100:00100000:2.0:1788658323.391900:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788658323.391909:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025122048:12345-0@lo:41: 00000004:00000024:2.0:1788658323.391940:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788658323.391987:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025122048:12345-0@lo:41: Request processed in 79us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658323.391994:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788658323.392425:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025122048:0@lo:41: 00010000:00010000:3.0:1788658323.902961:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788658324.901053:0:10055:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658324.901199:0:10055:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788658324.929829:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658325.952983:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658325.960112:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025122176:0@lo:41: 00000100:00100000:3.0:1788658325.960185:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658325.960289:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025122176 00000100:00100000:1.0:1788658325.960298:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025122176 00000100:00100000:1.0:1788658325.960349:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788658325.960359:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025122176:12345-0@lo:41: 00000004:00000024:1.0:1788658325.960404:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788658325.968494:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025122176:12345-0@lo:41: Request processed in 8125us (8297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658325.968511:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658325.971885:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025122176:0@lo:41: 00000020:00000004:2.0:1788658326.094074:0:10103:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658326.094086:0:10103:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1788658326.597028:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.597269:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000954496 00000100:00100000:0.0:1788658326.597279:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000954496 00000100:00100000:0.0:1788658326.597427:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 180 00000100:00100000:0.0:1788658326.597436:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1875544000954496:12345-192.168.202.53@tcp:250: 00010000:00080000:0.0:1788658326.597466:0:6530:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 552b02cf-e822-4974-bfd4-4217116bc45f@192.168.202.53@tcp t0 exp 0000000000000000 cur 243 last 0 00000020:00000080:0.0:1788658326.597498:0:6530:0:(genops.c:1385:class_connect()) connect: client 552b02cf-e822-4974-bfd4-4217116bc45f, cookie 0x48e67cc629c6e87d 00000100:00080000:0.0:1788658326.598537:0:6530:0:(import.c:65:import_set_state_nolock()) ffff8a1d81abf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658326.598615:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+5:2395:x1875544000954496:12345-192.168.202.53@tcp:250: Request processed in 1178us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658326.598625:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 180 00000100:00100000:2.0:1788658326.610366:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.611047:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000954624 00000100:00100000:0.0:1788658326.611058:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000954624 00000100:00100000:0.0:1788658326.611119:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:0.0:1788658326.611129:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+5:6157:x1875544000954624:12345-192.168.202.53@tcp:101: 00010000:00010000:0.0:1788658326.611146:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658326.611303:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e884 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc5b9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658326.611346:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5b9 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658326.611358:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5b9 expref: 6 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658326.611369:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031e00, rc 0) 00000100:00100000:0.0:1788658326.611747:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+6:6157:x1875544000954624:12345-192.168.202.53@tcp:101: Request processed in 607us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658326.611755:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:2.0:1788658326.632227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658326.632416:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000954752 00000100:00100000:1.0:1788658326.632427:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000954752 00000100:00100000:1.0:1788658326.632482:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00100000:1.0:1788658326.632493:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+6:6157:x1875544000954752:12345-192.168.202.53@tcp:501: 00000100:00100000:1.0:1788658326.632648:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+6:6157:x1875544000954752:12345-192.168.202.53@tcp:501: Request processed in 156us (429us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658326.632656:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00100000:1.0:1788658326.642125:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.642266:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000954880 00000100:00100000:0.0:1788658326.642276:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000954880 00000100:00100000:0.0:1788658326.642414:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 183 00000100:00100000:0.0:1788658326.642425:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+6:6157:x1875544000954880:12345-192.168.202.53@tcp:101: 00010000:00010000:0.0:1788658326.642440:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658326.642457:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e88b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc5c0 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658326.642486:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5c0 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658326.642498:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5c0 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658326.642508:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80030200, rc 0) 00000100:00100000:0.0:1788658326.647456:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+7:6157:x1875544000954880:12345-192.168.202.53@tcp:101: Request processed in 146us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658326.647496:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 183 00000100:00100000:2.0:1788658326.651427:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.651657:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000955008 00000100:00100000:0.0:1788658326.651667:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000955008 00000100:00100000:0.0:1788658326.651870:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 184 00000100:00100000:0.0:1788658326.651882:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+7:6157:x1875544000955008:12345-192.168.202.53@tcp:501: 00000100:00100000:0.0:1788658326.652070:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+8:6157:x1875544000955008:12345-192.168.202.53@tcp:501: Request processed in 190us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658326.652080:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 184 00000100:00100000:1.0:1788658326.659526:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.659730:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000955136 00000100:00100000:0.0:1788658326.659740:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000955136 00000100:00100000:0.0:1788658326.660450:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 185 00000100:00100000:0.0:1788658326.660464:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+8:6157:x1875544000955136:12345-192.168.202.53@tcp:503: 00000100:00100000:0.0:1788658326.660644:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+8:6157:x1875544000955136:12345-192.168.202.53@tcp:503: Request processed in 184us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658326.660653:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 185 00000100:00100000:3.0:1788658326.670962:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658326.671754:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000955264 00000100:00100000:2.0:1788658326.671768:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000955264 00000100:00100000:2.0:1788658326.671824:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 186 00000100:00100000:2.0:1788658326.671834:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e88550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+8:6176:x1875544000955264:12345-192.168.202.53@tcp:502: 00000100:00100000:2.0:1788658326.672003:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e88550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+8:6176:x1875544000955264:12345-192.168.202.53@tcp:502: Request processed in 170us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658326.672011:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 186 00000100:00100000:3.0:1788658326.733167:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.735282:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000955392 00000100:00100000:0.0:1788658326.735307:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000955392 00000100:00100000:0.0:1788658326.735403:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 187 00000100:00100000:0.0:1788658326.735416:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+8:6176:x1875544000955392:12345-192.168.202.53@tcp:502: 00000100:00100000:0.0:1788658326.735606:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+8:6176:x1875544000955392:12345-192.168.202.53@tcp:502: Request processed in 191us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658326.735615:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 187 00000100:00100000:1.0:1788658326.748839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.749114:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000955520 00000100:00100000:0.0:1788658326.749125:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000955520 00000100:00100000:0.0:1788658326.749196:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 188 00000100:00100000:0.0:1788658326.749222:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e915d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+8:6157:x1875544000955520:12345-192.168.202.53@tcp:101: 00010000:00010000:0.0:1788658326.749240:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658326.749258:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e80030e00/0x48e67cc629c6e892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc5f1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658326.749287:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e80030e00/0x48e67cc629c6e892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f1 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658326.749299:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e80030e00/0x48e67cc629c6e892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f1 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658326.749308:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80030e00, rc 0) 00000100:00100000:0.0:1788658326.749376:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e915d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+9:6157:x1875544000955520:12345-192.168.202.53@tcp:101: Request processed in 157us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658326.749383:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 188 00000100:00100000:3.0:1788658326.762831:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.763342:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000955648 00000100:00100000:0.0:1788658326.763353:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000955648 00000100:00100000:0.0:1788658326.763479:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 189 00000100:00100000:0.0:1788658326.763491:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+9:6157:x1875544000955648:12345-192.168.202.53@tcp:256: 20000000:01000000:0.0:1788658326.763522:0:6531:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788658326.763547:0:6531:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788658326.763550:0:6531:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788658326.763553:0:6531:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788658326.763556:0:6531:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788658326.763558:0:6531:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788658326.771623:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+9:6157:x1875544000955648:12345-192.168.202.53@tcp:256: Request processed in 8120us (8790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658326.771639:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 189 00000100:00100000:1.0:1788658326.782120:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658326.782293:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000955776 00000100:00100000:2.0:1788658326.782304:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000955776 00000100:00100000:2.0:1788658326.782374:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 190 00000100:00100000:2.0:1788658326.782385:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+9:6157:x1875544000955776:12345-192.168.202.53@tcp:101: 00010000:00010000:2.0:1788658326.782412:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658326.782432:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c6e899 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc5f8 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658326.782462:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c6e899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f8 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658326.782475:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c6e899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f8 expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658326.782484:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390400, rc 0) 00000100:00100000:2.0:1788658326.782551:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:6157:x1875544000955776:12345-192.168.202.53@tcp:101: Request processed in 168us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658326.782558:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 190 00000100:00100000:3.0:1788658326.790451:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658326.794002:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000955904 00000100:00100000:1.0:1788658326.794017:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000955904 00000100:00100000:0.0:1788658326.794197:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 191 00000100:00100000:0.0:1788658326.794208:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:6157:x1875544000955904:12345-192.168.202.53@tcp:501: 00000100:00100000:0.0:1788658326.794511:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:6157:x1875544000955904:12345-192.168.202.53@tcp:501: Request processed in 304us (4068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658326.794537:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 191 00000100:00100000:3.0:1788658326.798115:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.798242:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000956032 00000100:00100000:0.0:1788658326.798251:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000956032 00000100:00100000:0.0:1788658326.798318:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:0.0:1788658326.798329:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:6157:x1875544000956032:12345-192.168.202.53@tcp:503: 00000100:00100000:0.0:1788658326.798529:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:6157:x1875544000956032:12345-192.168.202.53@tcp:503: Request processed in 201us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658326.798538:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:1.0:1788658326.808593:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658326.808691:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000956160 00000100:00100000:2.0:1788658326.808741:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000956160 00000100:00100000:2.0:1788658326.808797:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 193 00000100:00100000:2.0:1788658326.808808:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:6182:x1875544000956160:12345-192.168.202.53@tcp:502: 00000100:00100000:2.0:1788658326.808975:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:6182:x1875544000956160:12345-192.168.202.53@tcp:502: Request processed in 168us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658326.808983:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 193 00000100:00100000:3.0:1788658326.814310:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.814385:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000956288 00000100:00100000:0.0:1788658326.814422:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000956288 00000100:00100000:0.0:1788658326.814482:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 194 00000100:00100000:0.0:1788658326.814491:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:6182:x1875544000956288:12345-192.168.202.53@tcp:502: 00000100:00100000:0.0:1788658326.814654:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:6182:x1875544000956288:12345-192.168.202.53@tcp:502: Request processed in 163us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658326.814663:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 194 00000100:00100000:0.0:1788658326.826953:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658326.827006:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658326.827102:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000956416 00000100:00100000:2.0:1788658326.827112:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000956416 00000100:00100000:2.0:1788658326.827154:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000956672 00000100:00100000:2.0:1788658326.827157:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000956672 00000100:00100000:2.0:1788658326.827183:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1788658326.827192:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1875544000956416:12345-192.168.202.53@tcp:38: 00010000:00080000:2.0:1788658326.827225:0:6536:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1788658326.827285:0:6536:0:(genops.c:1385:class_connect()) connect: client 8cbe5c26-08aa-4214-8c09-2005fb4b10e9, cookie 0x48e67cc629c6e8a0 00000004:00100000:2.0:1788658326.827311:0:6536:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788658326.827430:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1788658326.827438:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1875544000956672:12345-192.168.202.53@tcp:38: 00010000:00080000:3.0:1788658326.827458:0:6538:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:3.0:1788658326.827503:0:6538:0:(genops.c:1385:class_connect()) connect: client 8cbe5c26-08aa-4214-8c09-2005fb4b10e9, cookie 0x48e67cc629c6e8a7 00000004:00100000:3.0:1788658326.827518:0:6538:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788658326.827594:0:6536:0:(import.c:65:import_set_state_nolock()) ffff8a1d82764800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658326.827674:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2395:x1875544000956416:12345-192.168.202.53@tcp:38: Request processed in 480us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658326.827682:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00080000:3.0:1788658326.832613:0:6538:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7417800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658326.835629:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2395:x1875544000956672:12345-192.168.202.53@tcp:38: Request processed in 8178us (8610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658326.835656:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00010000:00010000:3.0:1788658326.974917:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658327.487035:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025122560:0@lo:400: 00000100:00100000:3.0:1788658327.487109:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658327.487169:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025123072:0@lo:400: 00000100:00100000:3.0:1788658327.487207:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658327.487225:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025123584:0@lo:400: 00000100:00100000:0.0:1788658327.487226:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025122304:0@lo:400: 00000100:00100000:3.0:1788658327.487247:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658327.487258:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658327.487275:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788658327.487276:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025122816:0@lo:400: 00000100:00100000:3.0:1788658327.487280:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025122432:0@lo:400: 00000100:00100000:3.0:1788658327.487297:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658327.487297:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658327.487310:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025122944:0@lo:400: 00000100:00100000:0.0:1788658327.487310:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025123328:0@lo:400: 00000100:00100000:0.0:1788658327.487334:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658327.487339:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658327.487349:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025123840:0@lo:400: 00000100:00100000:3.0:1788658327.487352:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025123456:0@lo:400: 00000100:00100000:3.0:1788658327.487369:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658327.487375:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658327.487391:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025122560 00000100:00100000:0.0:1788658327.487392:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788658327.487397:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025122688:0@lo:400: 00000100:00100000:3.0:1788658327.487399:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025122560 00000100:00100000:0.0:1788658327.487431:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658327.487442:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025123200:0@lo:400: 00000100:00100000:3.0:1788658327.487448:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025122816 00000100:00100000:3.0:1788658327.487451:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025122816 00000100:00100000:0.0:1788658327.487463:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658327.487467:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788658327.487475:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025122560:12345-0@lo:400: 00000100:00100000:0.0:1788658327.487479:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025123712:0@lo:400: 00000100:00100000:0.0:1788658327.487497:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658327.487516:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025123328 00000100:00100000:0.0:1788658327.487520:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025123328 00000100:00100000:3.0:1788658327.487524:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025122560:12345-0@lo:400: Request processed in 49us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.487532:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788658327.487547:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025123840 00000100:00100000:3.0:1788658327.487549:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788658327.487550:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025123840 00000100:00100000:3.0:1788658327.487555:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025122816:12345-0@lo:400: 00000100:00100000:0.0:1788658327.487560:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025123200 00000100:00100000:0.0:1788658327.487563:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025123200 00000100:00100000:0.0:1788658327.487574:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025123712 00000100:00100000:0.0:1788658327.487577:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025123712 00000100:00100000:3.0:1788658327.487587:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025122816:12345-0@lo:400: Request processed in 32us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658327.487589:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658327.487593:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788658327.487595:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025123328:12345-0@lo:400: 00000100:00100000:0.0:1788658327.487625:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025123328:12345-0@lo:400: Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.487629:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025123072 00000100:00100000:3.0:1788658327.487631:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025123072 00000100:00100000:0.0:1788658327.487632:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788658327.487645:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658327.487650:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025123584 00000100:00100000:0.0:1788658327.487651:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025123840:12345-0@lo:400: 00000100:00100000:3.0:1788658327.487652:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025123584 00000100:00100000:3.0:1788658327.487662:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025122432 00000100:00100000:3.0:1788658327.487664:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025122432 00000100:00100000:0.0:1788658327.487675:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025123840:12345-0@lo:400: Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.487676:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025122944 00000100:00100000:3.0:1788658327.487678:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025122944 00000100:00100000:0.0:1788658327.487681:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658327.487689:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025123456 00000100:00100000:3.0:1788658327.487691:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025123456 00000100:00100000:0.0:1788658327.487691:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658327.487696:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025123200:12345-0@lo:400: 00000100:00100000:3.0:1788658327.487721:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025122688 00000100:00100000:3.0:1788658327.487723:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025122688 00000100:00100000:3.0:1788658327.487746:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658327.487752:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025123072:12345-0@lo:400: 00000100:00100000:0.0:1788658327.487761:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025123200:12345-0@lo:400: Request processed in 65us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658327.487767:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658327.487778:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658327.487780:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025123072:12345-0@lo:400: Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.487786:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658327.487798:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788658327.487803:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025123584:12345-0@lo:400: 00000100:00100000:3.0:1788658327.487830:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025123584:12345-0@lo:400: Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.487836:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788658327.487847:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788658327.487852:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025122432:12345-0@lo:400: 00000100:00100000:3.0:1788658327.487891:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025122432:12345-0@lo:400: Request processed in 38us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658327.487891:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025123712:12345-0@lo:400: 00000100:00100000:3.0:1788658327.487898:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788658327.487910:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658327.487916:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025122944:12345-0@lo:400: 00000100:00100000:0.0:1788658327.487919:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025123712:12345-0@lo:400: Request processed in 137us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658327.487925:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658327.487937:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025122944:12345-0@lo:400: Request processed in 22us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.487943:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658327.487952:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788658327.487957:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025123456:12345-0@lo:400: 00000100:00100000:3.0:1788658327.487979:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025123456:12345-0@lo:400: Request processed in 23us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.487985:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788658327.487996:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788658327.488008:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025122688:12345-0@lo:400: 00000100:00100000:3.0:1788658327.488036:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025122688:12345-0@lo:400: Request processed in 29us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.488042:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788658327.488078:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e98369500 x1875544025122432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788658327.488085:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eebb80 x1875544025122688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658327.488091:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025122432:0@lo:400: 00000100:00100000:0.0:1788658327.488093:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025122688:0@lo:400: 00010000:00080000:3.0:1788658327.488102:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ee9c00 x1875544025122944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788658327.488102:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ee9880 x1875544025123200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658327.488111:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025122944:0@lo:400: 00000100:00100000:0.0:1788658327.488111:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025123200:0@lo:400: 00010000:00080000:3.0:1788658327.488119:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ee9180 x1875544025123456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788658327.488120:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eea300 x1875544025123712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658327.488127:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025123456:0@lo:400: 00000100:00100000:0.0:1788658327.488128:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788658327.488136:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025122560:0@lo:400: 00000100:00100000:0.0:1788658327.488141:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025123712:0@lo:400: 00010000:00080000:3.0:1788658327.488143:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eeb480 x1875544025123072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658327.488149:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025122816:0@lo:400: 00000100:00100000:3.0:1788658327.488150:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025123072:0@lo:400: 00010000:00080000:0.0:1788658327.488157:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eeaa00 x1875544025123328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788658327.488158:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ee8000 x1875544025123584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658327.488165:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025123328:0@lo:400: 00000100:00100000:3.0:1788658327.488166:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025123584:0@lo:400: 00010000:00080000:0.0:1788658327.488173:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eeb100 x1875544025123840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658327.488184:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658327.488185:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788658327.488188:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025123968:0@lo:13: 00000100:00100000:0.0:1788658327.488193:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025123840:0@lo:400: 00000100:00100000:3.0:1788658327.488211:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658327.488216:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025122304 00000100:00100000:0.0:1788658327.488220:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025122304 00000100:00100000:0.0:1788658327.488245:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788658327.488251:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025122304:12345-0@lo:400: 00000100:00100000:0.0:1788658327.488299:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025122304:12345-0@lo:400: Request processed in 48us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658327.488305:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1788658327.488523:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658327.488527:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658327.488530:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658327.488531:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658327.488541:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025123968 00000100:00100000:1.0:1788658327.488545:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025123968 00000100:00100000:1.0:1788658327.488570:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658327.488577:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025123968:12345-0@lo:13: 00002000:00000024:1.0:1788658327.488599:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658327.488633:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025123968:12345-0@lo:13: Request processed in 56us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658327.488639:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788658327.488663:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658327.488672:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025124096:0@lo:13: 00000100:00100000:0.0:1788658327.488699:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788658327.488739:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ee8700 x1875544025123968/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658327.488754:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025123968:0@lo:13: 00000100:00100000:1.0:1788658327.488851:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025124096 00000100:00100000:1.0:1788658327.488855:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025124096 00000100:00100000:1.0:1788658327.488884:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658327.488890:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025124096:12345-0@lo:13: 00002000:00000024:1.0:1788658327.488900:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658327.492939:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025122304:0@lo:400: 00000100:00100000:1.0:1788658327.494854:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025124096:12345-0@lo:13: Request processed in 5954us (6143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658327.494869:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788658327.496529:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef4a80 x1875544025124096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658327.496556:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025124096:0@lo:13: 00000100:00100000:0.0:1788658327.833561:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658327.833610:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658327.833641:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658327.833745:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000956928 00000100:00100000:1.0:1788658327.833755:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000956928 00000100:00100000:2.0:1788658327.833797:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000956800 00000100:00100000:2.0:1788658327.833801:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000956800 00000100:00100000:1.0:1788658327.833816:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000956544 00000100:00100000:1.0:1788658327.833818:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000956544 00000100:00100000:2.0:1788658327.833826:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:2.0:1788658327.833835:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:6157:x1875544000956928:12345-192.168.202.53@tcp:41: 00000004:00000024:2.0:1788658327.833872:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788658327.833936:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:6157:x1875544000956928:12345-192.168.202.53@tcp:41: Request processed in 101us (386us total) trans 0 rc 0/0 00000100:00080000:0.0:1788658327.833977:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658327.833981:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658327.834336:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:1.0:1788658327.834345:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:0:x1875544000956800:12345-192.168.202.53@tcp:41: 00000004:00000024:1.0:1788658327.834383:0:7958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788658327.834415:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:0:x1875544000956800:12345-192.168.202.53@tcp:41: Request processed in 71us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658327.834435:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:1.0:1788658327.834453:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:1.0:1788658327.834460:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:0:x1875544000956544:12345-192.168.202.53@tcp:41: 00000004:00000024:1.0:1788658327.834471:0:7958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788658327.834493:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:0:x1875544000956544:12345-192.168.202.53@tcp:41: Request processed in 33us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658327.834499:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:2.0:1788658327.839743:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:1.0:1788658327.843853:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658327.844055:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000957056 00000100:00100000:3.0:1788658327.844066:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000957056 00000100:00100000:3.0:1788658327.844131:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:3.0:1788658327.844142:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6157:x1875544000957056:12345-192.168.202.53@tcp:40: 00000100:00100000:3.0:1788658327.844239:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6157:x1875544000957056:12345-192.168.202.53@tcp:40: Request processed in 97us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.844247:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:1.0:1788658327.847253:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658327.847294:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658327.847326:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658327.847436:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000957184 00000100:00100000:0.0:1788658327.847447:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000957184 00000100:00100000:0.0:1788658327.847489:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000957312 00000100:00100000:0.0:1788658327.847492:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000957312 00000100:00100000:0.0:1788658327.847507:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:0.0:1788658327.847516:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1875544000957184:12345-192.168.202.53@tcp:8: 00010000:00080000:0.0:1788658327.847561:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1788658327.847593:0:8453:0:(genops.c:1385:class_connect()) connect: client 8cbe5c26-08aa-4214-8c09-2005fb4b10e9, cookie 0x48e67cc629c6e8ae 00002000:00100000:0.0:1788658327.847607:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8cbe5c26-08aa-4214-8c09-2005fb4b10e9/ffff8a1d81ab9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658327.847625:0:8453:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658327.847841:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788658327.847872:0:8453:0:(import.c:65:import_set_state_nolock()) ffff8a1d81abe800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658327.848311:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2395:x1875544000957184:12345-192.168.202.53@tcp:8: Request processed in 419us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658327.848320:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:0.0:1788658327.848343:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:0.0:1788658327.848347:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1875544000957312:12345-192.168.202.53@tcp:8: 00010000:00080000:0.0:1788658327.848367:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:0.0:1788658327.848386:0:8453:0:(genops.c:1385:class_connect()) connect: client 8cbe5c26-08aa-4214-8c09-2005fb4b10e9, cookie 0x48e67cc629c6e8b5 00002000:00100000:0.0:1788658327.848392:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8cbe5c26-08aa-4214-8c09-2005fb4b10e9/ffff8a1ebdc09800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658327.848400:0:8453:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658327.848529:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788658327.848547:0:8453:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc0d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658327.848693:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2395:x1875544000957312:12345-192.168.202.53@tcp:8: Request processed in 342us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658327.848717:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1788658327.849634:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000957440 00000100:00100000:3.0:1788658327.849644:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000957440 00000100:00100000:0.0:1788658327.849756:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:0.0:1788658327.849766:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6157:x1875544000957440:12345-192.168.202.53@tcp:900: 00000100:00100000:1.0:1788658327.850150:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658327.850208:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6157:x1875544000957440:12345-192.168.202.53@tcp:900: Request processed in 443us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658327.850229:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:3.0:1788658327.852355:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000957568 00000100:00100000:3.0:1788658327.852369:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000957568 00000100:00100000:3.0:1788658327.852479:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 196 00000100:00100000:3.0:1788658327.852490:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544000957568:12345-192.168.202.53@tcp:400: 00000100:00100000:3.0:1788658327.852566:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544000957568:12345-192.168.202.53@tcp:400: Request processed in 78us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.852574:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 196 00000100:00100000:2.0:1788658327.857604:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658327.857734:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000957696 00000100:00100000:3.0:1788658327.857745:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000957696 00000100:00100000:3.0:1788658327.857801:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:3.0:1788658327.857810:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6157:x1875544000957696:12345-192.168.202.53@tcp:33: 00000004:00080000:3.0:1788658327.873897:0:6539:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 15979us 00000004:00200000:3.0:1788658327.885480:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788658327.885657:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6157:x1875544000957696:12345-192.168.202.53@tcp:33: Request processed in 27838us (28057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658327.885670:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:3.0:1788658327.999164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025124224:0@lo:13: 00000100:00100000:3.0:1788658327.999271:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658327.999505:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025124224 00000100:00100000:2.0:1788658327.999517:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025124224 00000100:00100000:2.0:1788658327.999591:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788658327.999602:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025124224:12345-0@lo:13: 00002000:00000024:2.0:1788658327.999633:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658327.999687:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025124224:12345-0@lo:13: Request processed in 86us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658327.999695:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788658328.000014:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2251880 x1875544025124224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658328.000037:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025124224:0@lo:13: 00000100:00100000:3.0:1788658328.000061:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658328.000070:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025124352:0@lo:13: 00000100:00100000:3.0:1788658328.000099:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658328.000182:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658328.000287:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025124352 00000100:00100000:2.0:1788658328.000293:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025124352 00000100:00100000:2.0:1788658328.000328:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788658328.000336:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025124352:12345-0@lo:13: 00002000:00000024:2.0:1788658328.000351:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658328.000859:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025124352:12345-0@lo:13: Request processed in 278us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658328.000869:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788658328.001013:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb9ad80 x1875544025124352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658328.001033:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025124352:0@lo:13: 00000100:00100000:1.0:1788658328.065636:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658328.065821:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000957824 00000100:00100000:2.0:1788658328.065834:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000957824 00000100:00100000:2.0:1788658328.065979:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1788658328.065992:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6200:x1875544000957824:12345-192.168.202.53@tcp:101: 00010000:00010000:2.0:1788658328.066019:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658328.066054:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390800/0x48e67cc629c6e8bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc629 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658328.066144:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6e8c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658328.066161:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6e8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658328.066181:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6e8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658328.066246:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788658328.066251:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658328.066271:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6e8c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658328.066304:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390800/0x48e67cc629c6e8bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc629 expref: 8 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658328.066325:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6e8c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc629 expref: 7 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658328.066345:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83404300) 00010000:00010000:2.0:1788658328.066348:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658328.066353:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391800, rc 0) 00000100:00100000:2.0:1788658328.067139:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:6200:x1875544000957824:12345-192.168.202.53@tcp:101: Request processed in 1141us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658328.067161:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:3.0:1788658328.512314:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658328.512353:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025124480:0@lo:41: 00000100:00100000:3.0:1788658328.512490:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658328.512771:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025124480 00000100:00100000:1.0:1788658328.512782:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025124480 00000100:00100000:1.0:1788658328.513123:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788658328.513137:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025124480:12345-0@lo:41: 00000004:00000024:1.0:1788658328.513177:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788658328.513253:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025124480:12345-0@lo:41: Request processed in 120us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658328.513327:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025124480:0@lo:41: 00000100:00100000:1.0:1788658328.516442:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1788658329.023088:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658330.047137:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658330.251179:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658330.252134:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000957952 00000100:00100000:3.0:1788658330.252152:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000957952 00000100:00100000:3.0:1788658330.252265:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:3.0:1788658330.252280:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:6252:x1875544000957952:12345-192.168.202.53@tcp:41: 00000004:00000024:3.0:1788658330.252332:0:7958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788658330.252444:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:6252:x1875544000957952:12345-192.168.202.53@tcp:41: Request processed in 169us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658330.252453:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00080000:0.0:1788658330.252687:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658330.256987:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658330.257125:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000958080 00000100:00100000:0.0:1788658330.257138:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000958080 00000100:00100000:0.0:1788658330.257235:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:0.0:1788658330.257249:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6252:x1875544000958080:12345-192.168.202.53@tcp:41: 00000004:00000024:0.0:1788658330.257300:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788658330.257392:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6252:x1875544000958080:12345-192.168.202.53@tcp:41: Request processed in 147us (422us total) trans 0 rc 0/0 00000100:00080000:1.0:1788658330.257965:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658330.258043:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:2.0:1788658330.261698:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658330.261891:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000958208 00000100:00100000:1.0:1788658330.261905:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000958208 00000100:00100000:1.0:1788658330.262000:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:1.0:1788658330.262012:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6252:x1875544000958208:12345-192.168.202.53@tcp:13: 00002000:00000024:1.0:1788658330.262054:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658330.262143:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6252:x1875544000958208:12345-192.168.202.53@tcp:13: Request processed in 133us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658330.262150:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00080000:0.0:1788658330.263056:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658330.265232:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658330.265365:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000958336 00000100:00100000:1.0:1788658330.265380:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000958336 00000100:00100000:1.0:1788658330.265478:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:1.0:1788658330.265491:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6252:x1875544000958336:12345-192.168.202.53@tcp:13: 00002000:00000024:1.0:1788658330.265549:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658330.265638:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:6252:x1875544000958336:12345-192.168.202.53@tcp:13: Request processed in 151us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658330.265647:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00080000:0.0:1788658330.265729:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658331.072991:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658331.073025:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025124608:0@lo:41: 00000100:00100000:2.0:1788658331.073115:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658331.073197:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025124608 00000100:00100000:2.0:1788658331.073206:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025124608 00000100:00100000:2.0:1788658331.073261:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788658331.073272:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025124608:12345-0@lo:41: 00000004:00000024:2.0:1788658331.073321:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788658331.073375:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025124608:12345-0@lo:41: Request processed in 104us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658331.073382:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788658331.073436:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025124608:0@lo:41: 00010000:00010000:1.0:1788658331.073587:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788658331.588046:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00010000:00010000:2.0:1788658332.095026:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658332.608079:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025124736:0@lo:400: 00000100:00100000:1.0:1788658332.608189:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608246:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025125248:0@lo:400: 00000100:00100000:1.0:1788658332.608277:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608312:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025125760:0@lo:400: 00000100:00100000:1.0:1788658332.608488:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608512:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025126272:0@lo:400: 00000100:00100000:1.0:1788658332.608536:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608583:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788658332.608590:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025124864:0@lo:400: 00000100:00100000:1.0:1788658332.608617:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608637:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025125376:0@lo:400: 00000100:00100000:1.0:1788658332.608655:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608672:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025125888:0@lo:400: 00000100:00100000:1.0:1788658332.608691:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608749:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025124992:0@lo:400: 00000100:00100000:1.0:1788658332.608775:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608794:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025125504:0@lo:400: 00000100:00100000:1.0:1788658332.608812:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608830:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025126016:0@lo:400: 00000100:00100000:1.0:1788658332.608854:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608866:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788658332.608871:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025125120:0@lo:400: 00000100:00100000:1.0:1788658332.608890:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608899:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025125632:0@lo:400: 00000100:00100000:1.0:1788658332.608916:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608932:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025126144:0@lo:400: 00000100:00100000:1.0:1788658332.608962:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.608994:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025124736 00000100:00100000:1.0:1788658332.609002:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025124736 00000100:00100000:1.0:1788658332.609056:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788658332.609065:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025124736:12345-0@lo:400: 00000100:00100000:1.0:1788658332.609123:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025124736:12345-0@lo:400: Request processed in 59us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.609137:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788658332.609617:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025125248 00000100:00100000:1.0:1788658332.609623:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025125248 00000001:00100000:3.0:1788658332.619608:0:7466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000100:00100000:1.0:1788658332.623720:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025124992 00000100:00100000:1.0:1788658332.623743:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025124992 00000100:00100000:1.0:1788658332.623806:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788658332.623817:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025125248:12345-0@lo:400: 00000100:00100000:1.0:1788658332.623938:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025125248:12345-0@lo:400: Request processed in 123us (15659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.623945:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788658332.623964:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788658332.623970:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025124992:12345-0@lo:400: 00000100:00100000:1.0:1788658332.628635:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025124992:12345-0@lo:400: Request processed in 4648us (19843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.628655:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788658332.628743:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025125760 00000100:00100000:1.0:1788658332.628755:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025125760 00000100:00100000:1.0:1788658332.628831:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025126272 00000100:00100000:1.0:1788658332.628835:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025126272 00000100:00100000:1.0:1788658332.628851:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025125632 00000100:00100000:1.0:1788658332.628854:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025125632 00000100:00100000:1.0:1788658332.628867:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025126144 00000100:00100000:1.0:1788658332.628870:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025126144 00000100:00100000:1.0:1788658332.628889:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658332.628898:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025125760:12345-0@lo:400: 00000100:00100000:1.0:1788658332.628992:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025125760:12345-0@lo:400: Request processed in 95us (20651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.629000:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658332.629032:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658332.629038:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025126272:12345-0@lo:400: 00000100:00100000:1.0:1788658332.629072:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025126272:12345-0@lo:400: Request processed in 34us (20535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.629077:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658332.629087:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658332.629092:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025125632:12345-0@lo:400: 00000100:00100000:1.0:1788658332.629117:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025125632:12345-0@lo:400: Request processed in 25us (20199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.629122:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658332.629131:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658332.629137:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025126144:12345-0@lo:400: 00000100:00100000:1.0:1788658332.629162:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025126144:12345-0@lo:400: Request processed in 25us (20199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.629167:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658332.630778:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025124864 00000100:00100000:1.0:1788658332.630791:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025124864 00000100:00100000:1.0:1788658332.630832:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025125376 00000100:00100000:1.0:1788658332.630834:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025125376 00000100:00100000:1.0:1788658332.630850:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025125888 00000100:00100000:1.0:1788658332.630853:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025125888 00000100:00100000:1.0:1788658332.630865:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025125504 00000100:00100000:1.0:1788658332.630868:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025125504 00000100:00100000:1.0:1788658332.630879:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025126016 00000100:00100000:1.0:1788658332.630881:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025126016 00000100:00100000:1.0:1788658332.630895:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025125120 00000100:00100000:1.0:1788658332.630898:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025125120 00000100:00100000:1.0:1788658332.630915:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658332.630924:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025124864:12345-0@lo:400: 00000100:00100000:1.0:1788658332.631036:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025124864:12345-0@lo:400: Request processed in 113us (22418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.631043:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658332.631056:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658332.631062:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025125376:12345-0@lo:400: 00000100:00100000:1.0:1788658332.631088:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025125376:12345-0@lo:400: Request processed in 26us (22431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.631093:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658332.631102:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788658332.631107:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025125888:12345-0@lo:400: 00000100:00100000:1.0:1788658332.631131:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025125888:12345-0@lo:400: Request processed in 24us (22439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.631137:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788658332.631148:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788658332.631154:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025125504:12345-0@lo:400: 00000100:00100000:1.0:1788658332.632459:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025125504:12345-0@lo:400: Request processed in 1186us (23526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.632471:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788658332.632508:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788658332.632520:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025126016:12345-0@lo:400: 00000100:00100000:1.0:1788658332.632583:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025126016:12345-0@lo:400: Request processed in 58us (23717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.632590:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788658332.632605:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788658332.632612:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025125120:12345-0@lo:400: 00000100:00100000:1.0:1788658332.632660:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025125120:12345-0@lo:400: Request processed in 49us (23769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.632667:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788658332.632754:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658332.632760:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658332.632764:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658332.632767:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658332.632789:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025126400:0@lo:13: 00000100:00100000:1.0:1788658332.632840:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.632916:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025126400 00000100:00100000:1.0:1788658332.632925:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025126400 00000100:00100000:1.0:1788658332.632978:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658332.632985:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025126400:12345-0@lo:13: 00002000:00000024:1.0:1788658332.633034:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658332.633071:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025126400:12345-0@lo:13: Request processed in 87us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658332.633078:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788658332.633119:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ee8700 x1875544025126400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658332.633142:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025126400:0@lo:13: 00000100:00100000:1.0:1788658332.634069:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025126528:0@lo:13: 00000100:00100000:1.0:1788658332.634126:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658332.634189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025125120:0@lo:400: 00010000:00080000:1.0:1788658332.634208:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bdc00 x1875544025125632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658332.634217:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025125632:0@lo:400: 00010000:00080000:1.0:1788658332.634241:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bd180 x1875544025126144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658332.634247:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025126144:0@lo:400: 00000100:00100000:1.0:1788658332.634260:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025124992:0@lo:400: 00010000:00080000:1.0:1788658332.634271:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bd500 x1875544025125504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658332.634279:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025125504:0@lo:400: 00010000:00080000:1.0:1788658332.634584:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bea00 x1875544025126016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658332.634596:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025126016:0@lo:400: 00000100:00100000:2.0:1788658332.634635:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025126528 00000100:00100000:2.0:1788658332.634643:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025126528 00000100:00100000:1.0:1788658332.634660:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025124864:0@lo:400: 00000100:00100000:1.0:1788658332.634671:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025125376:0@lo:400: 00000100:00100000:1.0:1788658332.634685:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025125888:0@lo:400: 00000100:00100000:2.0:1788658332.634694:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658332.634696:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025124736:0@lo:400: 00000100:00100000:2.0:1788658332.634720:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025126528:12345-0@lo:13: 00000100:00100000:1.0:1788658332.634726:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025125248:0@lo:400: 00010000:00080000:1.0:1788658332.634739:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bf480 x1875544025125760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:2.0:1788658332.634742:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658332.634749:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025125760:0@lo:400: 00010000:00080000:1.0:1788658332.634759:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bc000 x1875544025126272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658332.634766:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025126272:0@lo:400: 00000100:00100000:2.0:1788658332.634796:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025126528:12345-0@lo:13: Request processed in 95us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658332.634803:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788658332.634810:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d81b39880 x1875544025126528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658332.634822:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025126528:0@lo:13: 00000001:00100000:3.0:1788658332.644990:0:6515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000100:00100000:0.0:1788658332.869839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658332.869889:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658332.869926:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658332.869964:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000958464 00000100:00100000:0.0:1788658332.869977:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000958464 00000100:00100000:0.0:1788658332.870042:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 198 00000100:00100000:0.0:1788658332.870054:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:2399:x1875544000958464:12345-192.168.202.53@tcp:400: 00000100:00100000:0.0:1788658332.870144:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:2399:x1875544000958464:12345-192.168.202.53@tcp:400: Request processed in 93us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658332.870153:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 198 00000100:00100000:0.0:1788658332.870196:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000958720 00000100:00100000:0.0:1788658332.870200:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000958720 00000100:00100000:0.0:1788658332.870266:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1788658332.870273:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000958720:12345-192.168.202.53@tcp:400: 00000100:00100000:0.0:1788658332.870309:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000958720:12345-192.168.202.53@tcp:400: Request processed in 36us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658332.870316:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1788658332.870337:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000958976 00000100:00100000:0.0:1788658332.870340:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000958976 00000100:00100000:0.0:1788658332.870388:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:0.0:1788658332.870394:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000958976:12345-192.168.202.53@tcp:400: 00000100:00100000:0.0:1788658332.870424:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000958976:12345-192.168.202.53@tcp:400: Request processed in 30us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658332.870430:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00080000:0.0:1788658332.870596:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658332.870602:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658332.879265:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658332.879335:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658332.879425:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000958848 00000100:00100000:2.0:1788658332.879438:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000958848 00000100:00100000:2.0:1788658332.879536:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:2.0:1788658332.879548:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544000958848:12345-192.168.202.53@tcp:400: 00000100:00100000:2.0:1788658332.879653:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544000958848:12345-192.168.202.53@tcp:400: Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658332.879661:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00080000:3.0:1788658332.880097:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658332.880194:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000958592 00000100:00100000:0.0:1788658332.880200:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000958592 00000100:00080000:3.0:1788658332.880292:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658332.880334:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:0.0:1788658332.880355:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544000958592:12345-192.168.202.53@tcp:400: 00000100:00100000:0.0:1788658332.880413:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544000958592:12345-192.168.202.53@tcp:400: Request processed in 72us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658332.880421:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00000001:02000400:0.0:1788658332.954789:0:10201:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788658333.118937:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658333.118978:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025126656:0@lo:13: 00000100:00100000:3.0:1788658333.118987:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025126784:0@lo:13: 00000100:00100000:3.0:1788658333.126795:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658333.126923:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025126784 00000100:00100000:3.0:1788658333.126936:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025126784 00000100:00100000:3.0:1788658333.127001:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658333.127366:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025126784:12345-0@lo:13: 00002000:00000024:3.0:1788658333.127416:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658333.127469:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658333.127481:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025126784:12345-0@lo:13: Request processed in 470us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658333.127488:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658333.127507:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025126656 00000100:00100000:3.0:1788658333.127511:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025126656 00000100:00100000:3.0:1788658333.127528:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658333.127535:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025126656:12345-0@lo:13: 00002000:00000024:3.0:1788658333.127545:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658333.127581:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025126656:12345-0@lo:13: Request processed in 47us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658333.127597:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788658333.127641:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377c380 x1875544025126656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788658333.127672:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658333.127679:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025126656:0@lo:13: 00010000:00080000:3.0:1788658333.127807:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ee9500 x1875544025126784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658333.127835:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025126784:0@lo:13: 00000100:00100000:1.0:1788658333.633523:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025126912:0@lo:41: 00000100:00100000:1.0:1788658333.633634:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658333.633998:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025126912 00000100:00100000:2.0:1788658333.634009:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025126912 00000100:00100000:2.0:1788658333.634072:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658333.634084:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025126912:12345-0@lo:41: 00000004:00000024:2.0:1788658333.634131:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788658333.634214:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025126912:12345-0@lo:41: Request processed in 131us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658333.634222:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788658333.634593:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025126912:0@lo:41: 00000001:00100000:3.0:1788658333.639158:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00010000:00010000:1.0:1788658334.147130:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658335.168164:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658336.190859:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658336.191054:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658336.191085:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025127040:0@lo:41: 00000100:00100000:2.0:1788658336.191184:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658336.191323:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025127040 00000100:00100000:3.0:1788658336.191333:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025127040 00000100:00100000:3.0:1788658336.191387:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788658336.191398:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025127040:12345-0@lo:41: 00000004:00000024:3.0:1788658336.191441:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658336.191494:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025127040:12345-0@lo:41: Request processed in 97us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658336.191501:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788658336.192727:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025127040:0@lo:41: 00000020:00000080:1.0:1788658336.869274:0:10348:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe32e789b0 20000000:00000080:1.0:1788658336.869300:0:10348:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1d834da000 uarg=0000000000000000 20000000:01000000:1.0:1788658336.869348:0:10348:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788658336.869350:0:10348:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788658336.869353:0:10348:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788658336.869360:0:10348:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788658336.869367:0:10348:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788658336.869443:0:10348:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788658336.869446:0:10348:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788658336.870517:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788658336.871247:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788658336.871287:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788658336.871304:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1788658336.871316:0:10348:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788658336.871319:0:10348:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788658336.872247:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788658336.872517:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788658336.872546:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788658336.872562:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788658336.872572:0:10348:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788658336.872575:0:10348:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788658336.873227:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788658336.873381:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788658336.873404:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788658336.873436:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788658336.873445:0:10348:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788658336.873448:0:10348:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788658336.873844:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788658336.874312:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788658336.874342:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788658336.874359:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788658336.874370:0:10348:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788658336.874373:0:10348:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788658336.875025:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788658336.875848:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788658336.875880:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788658336.875893:0:10348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:2.0:1788658336.875917:0:10348:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788658336.875942:0:10348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.875966:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e75e expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.875975:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e78f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e788 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.875982:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e7ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e7c7 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.875989:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c6e7dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e7d5 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.875997:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e7e3 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876004:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6e806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e7ff expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876011:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b96600/0x48e67cc629c6e830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e829 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876018:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b97c00/0x48e67cc629c6e84c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e845 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876025:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c6e876 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e86f expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876036:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e884 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5b9 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876051:0:10348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e88b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5c0 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876060:0:10348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876112:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5c0 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876131:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e88b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5c0 expref: 9 pid: 6531 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876148:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127168:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658336.876363:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5b9 expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876372:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5b9 expref: 9 pid: 6531 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876381:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127296:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658336.876415:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c6e876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e86f expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876424:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c6e876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e86f expref: 23 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876433:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127424:0@lo:104: 00000100:00100000:2.0:1788658336.876484:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658336.876542:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b97c00/0x48e67cc629c6e84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e845 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876550:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e82b97c00/0x48e67cc629c6e84c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e845 expref: 23 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876558:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127552:0@lo:104: 00000100:00100000:2.0:1788658336.876579:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658336.876602:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b96600/0x48e67cc629c6e830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e829 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876611:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e82b96600/0x48e67cc629c6e830 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e829 expref: 23 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876618:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127680:0@lo:104: 00000100:00100000:2.0:1788658336.876654:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658336.876675:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6e806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e7ff expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876682:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6e806 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e7ff expref: 23 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876690:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127808:0@lo:104: 00000100:00100000:2.0:1788658336.876749:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658336.876766:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e7e3 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876774:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e7e3 expref: 23 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876781:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127936:0@lo:104: 00010000:00010000:2.0:1788658336.876813:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c6e7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e7d5 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876821:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c6e7dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e7d5 expref: 23 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876828:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025128064:0@lo:104: 00010000:00010000:2.0:1788658336.876853:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e7c7 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876860:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e7ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e7c7 expref: 23 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876868:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025128192:0@lo:104: 00010000:00010000:2.0:1788658336.876890:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e788 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876896:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e78f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e788 expref: 23 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876905:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025128320:0@lo:104: 00010000:00010000:2.0:1788658336.876928:0:10348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e75e expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.876935:0:10348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e765 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e75e expref: 23 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.876943:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025128448:0@lo:104: 00000100:00100000:2.0:1788658336.876963:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658336.877072:0:6520:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788658336.877093:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658336.877106:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658336.877114:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658336.877120:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658336.877126:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658336.877135:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025127424 00000100:00100000:1.0:1788658336.877142:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025127424 00000100:00100000:1.0:1788658336.877188:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025127552 00000100:00100000:1.0:1788658336.877191:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025127552 00000100:00100000:1.0:1788658336.877201:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025127680 00000100:00100000:1.0:1788658336.877203:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025127680 00000100:00100000:1.0:1788658336.877210:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025127808 00000100:00100000:1.0:1788658336.877212:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025127808 00000100:00100000:1.0:1788658336.877221:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025127936 00000100:00100000:1.0:1788658336.877223:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025127936 00000100:00100000:1.0:1788658336.877230:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025128064 00000100:00100000:1.0:1788658336.877232:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025128064 00000100:00100000:1.0:1788658336.877241:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025128192 00000100:00100000:1.0:1788658336.877243:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025128192 00000100:00100000:1.0:1788658336.877250:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025128320 00000100:00100000:1.0:1788658336.877253:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025128320 00000100:00100000:1.0:1788658336.877262:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025128448 00000100:00100000:1.0:1788658336.877264:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025128448 00000100:00100000:1.0:1788658336.877278:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788658336.877289:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:10348:x1875544025127424:12345-0@lo:104: 00010000:00010000:1.0:1788658336.877305:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.877390:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658336.877397:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+11:10348:x1875544025127424:12345-0@lo:104: Request processed in 110us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658336.877404:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788658336.877427:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788658336.877434:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:10348:x1875544025127552:12345-0@lo:104: 00010000:00010000:1.0:1788658336.877443:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.877475:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788658336.877480:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+10:10348:x1875544025127552:12345-0@lo:104: Request processed in 48us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658336.877485:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788658336.877497:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658336.877503:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:10348:x1875544025127680:12345-0@lo:104: 00010000:00010000:1.0:1788658336.877510:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.877541:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788658336.877546:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+9:10348:x1875544025127680:12345-0@lo:104: Request processed in 44us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658336.877552:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658336.877562:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658336.877568:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+8:10348:x1875544025127808:12345-0@lo:104: 00010000:00010000:1.0:1788658336.877575:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.877607:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788658336.877611:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+8:10348:x1875544025127808:12345-0@lo:104: Request processed in 44us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658336.877616:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658336.877651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788658336.877658:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+7:10348:x1875544025127936:12345-0@lo:104: 00010000:00010000:1.0:1788658336.877665:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.877689:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788658336.877693:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+7:10348:x1875544025127936:12345-0@lo:104: Request processed in 37us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658336.877698:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788658336.877747:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788658336.877752:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:10348:x1875544025128064:12345-0@lo:104: 00010000:00010000:1.0:1788658336.877760:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.877785:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788658336.877790:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:10348:x1875544025128064:12345-0@lo:104: Request processed in 39us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658336.877795:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788658336.877806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658336.877811:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:10348:x1875544025128192:12345-0@lo:104: 00010000:00010000:1.0:1788658336.877819:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.877852:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788658336.877856:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:10348:x1875544025128192:12345-0@lo:104: Request processed in 46us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658336.877862:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658336.877874:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658336.877879:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:10348:x1875544025128320:12345-0@lo:104: 00010000:00010000:1.0:1788658336.877887:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.877910:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:1.0:1788658336.877915:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:10348:x1875544025128320:12345-0@lo:104: Request processed in 37us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658336.877921:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658336.877932:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788658336.877937:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:10348:x1875544025128448:12345-0@lo:104: 00010000:00010000:1.0:1788658336.877945:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.877970:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:1.0:1788658336.877975:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:10348:x1875544025128448:12345-0@lo:104: Request processed in 39us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658336.877980:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788658336.878001:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1788658336.878008:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878025:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658336.878030:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878040:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658336.878047:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658336.878053:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658336.878107:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878114:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658336.878138:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878145:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96200/0x48e67cc629c6e86f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e876 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878162:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1788658336.878165:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878172:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658336.878175:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878192:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658336.878198:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658336.878203:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658336.878217:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878222:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658336.878237:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878243:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6e845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e84c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878253:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788658336.878256:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878261:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658336.878264:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878271:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658336.878277:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658336.878290:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658336.878304:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878310:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658336.878316:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878323:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e80031a00/0x48e67cc629c6e829 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e830 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878336:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788658336.878340:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878345:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658336.878348:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878355:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658336.878361:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658336.878366:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658336.878377:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878382:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658336.878394:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878400:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e81671a00/0x48e67cc629c6e7ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e806 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878411:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788658336.878414:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878419:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031600 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658336.878422:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878428:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658336.878434:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658336.878440:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658336.878453:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878458:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658336.878463:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878469:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e80031600/0x48e67cc629c6e7e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e7ea expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878478:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788658336.878487:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878494:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658336.878497:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878504:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658336.878511:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658336.878517:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658336.878531:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878537:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658336.878541:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878546:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e80031200/0x48e67cc629c6e7d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e7dc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878556:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788658336.878559:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878565:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658336.878567:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878584:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658336.878590:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658336.878595:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658336.878608:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878613:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658336.878617:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878623:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e80030400/0x48e67cc629c6e7c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e7ce expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878633:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658336.878635:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878641:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658336.878644:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878651:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658336.878657:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658336.878669:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658336.878682:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878688:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658336.878692:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878698:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391200/0x48e67cc629c6e788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e78f expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878753:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658336.878756:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878762:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658336.878764:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878771:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658336.878777:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658336.878783:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788658336.878795:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878801:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658336.878812:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878819:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e81671400/0x48e67cc629c6e75e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e765 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.878837:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658336.878839:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658336.878841:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658336.878854:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658336.878873:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025128576:0@lo:103: 00000100:00100000:1.0:1788658336.878929:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658336.879382:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658336.879407:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025128960:0@lo:103: 00000100:00100000:3.0:1788658336.879581:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658336.879736:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127424:0@lo:104: 00000100:00100000:2.0:1788658336.879749:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127552:0@lo:104: 00000100:00100000:2.0:1788658336.879757:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127680:0@lo:104: 00000100:00100000:2.0:1788658336.879765:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127808:0@lo:104: 00000100:00100000:2.0:1788658336.879774:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127936:0@lo:104: 00000100:00100000:2.0:1788658336.879782:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025128064:0@lo:104: 00000100:00100000:2.0:1788658336.879791:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025128192:0@lo:104: 00000100:00100000:2.0:1788658336.879800:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025128320:0@lo:104: 00000100:00100000:2.0:1788658336.879809:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025128448:0@lo:104: 00000100:00100000:0.0:1788658336.879969:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025128576 00000100:00100000:0.0:1788658336.879979:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025128576 00010000:00010000:0.0:1788658336.880028:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c6e876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e86f expref: 24 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658336.880073:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025128960 00000100:00100000:0.0:1788658336.880077:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025128960 00010000:00010000:0.0:1788658336.880089:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6e806 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e7ff expref: 25 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658336.880112:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788658336.880121:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e8859d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+25:3650:x1875544025128576:12345-0@lo:103: 00010000:00010000:0.0:1788658336.880136:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658336.880142:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c6e876 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e86f expref: 25 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.880153:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c6e876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e86f expref: 25 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.880173:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b3000/0x48e67cc629c6e876 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e86f expref: 25 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.880194:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658336.880237:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e8859d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025128576:12345-0@lo:103: Request processed in 116us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658336.880244:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788658336.880300:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788658336.880306:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:3649:x1875544025128960:12345-0@lo:103: 00010000:00010000:0.0:1788658336.880329:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658336.880334:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6e806 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e7ff expref: 23 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.880343:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6e806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e7ff expref: 23 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.880352:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6e806 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e7ff expref: 23 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.880361:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658336.880385:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:3649:x1875544025128960:12345-0@lo:103: Request processed in 79us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658336.880391:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658336.880972:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025128704:0@lo:103: 00000100:00100000:2.0:1788658336.881020:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658336.881103:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025128704 00000100:00100000:0.0:1788658336.881109:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025128704 00010000:00010000:0.0:1788658336.881135:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b97c00/0x48e67cc629c6e84c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e845 expref: 22 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658336.881163:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658336.881171:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:3647:x1875544025128704:12345-0@lo:103: 00010000:00010000:0.0:1788658336.881182:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658336.881187:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b97c00/0x48e67cc629c6e84c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e845 expref: 22 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.881196:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b97c00/0x48e67cc629c6e84c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e845 expref: 22 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.881209:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b97c00/0x48e67cc629c6e84c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e845 expref: 22 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.881237:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658336.881266:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3647:x1875544025128704:12345-0@lo:103: Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658336.881274:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658336.881945:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025128576:0@lo:103: 00000100:00100000:1.0:1788658336.881957:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025129088:0@lo:103: 00000100:00100000:1.0:1788658336.882001:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658336.882038:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025129600:0@lo:103: 00000100:00100000:1.0:1788658336.882057:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658336.882113:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025128832:0@lo:103: 00000100:00100000:1.0:1788658336.882138:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658336.882154:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025129344:0@lo:103: 00000100:00100000:1.0:1788658336.882171:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658336.882312:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025129088 00000100:00100000:0.0:1788658336.882319:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025129088 00010000:00010000:0.0:1788658336.882348:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e7e3 expref: 21 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658336.882370:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025129600 00000100:00100000:0.0:1788658336.882373:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025129600 00010000:00010000:0.0:1788658336.882396:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e765 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e75e expref: 22 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658336.882407:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025128832 00000100:00100000:0.0:1788658336.882410:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025128832 00010000:00010000:0.0:1788658336.882421:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b96600/0x48e67cc629c6e830 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e829 expref: 23 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658336.882430:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025129344 00000100:00100000:0.0:1788658336.882432:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025129344 00010000:00010000:0.0:1788658336.882442:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e7ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e7c7 expref: 24 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658336.882453:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788658336.882461:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025129088:12345-0@lo:103: 00010000:00010000:0.0:1788658336.882474:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658336.882479:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e7e3 expref: 24 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882503:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e7e3 expref: 24 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882519:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81670c00/0x48e67cc629c6e7ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e7e3 expref: 24 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882535:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658336.882577:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:3650:x1875544025129088:12345-0@lo:103: Request processed in 117us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658336.882584:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788658336.882601:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788658336.882607:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:3650:x1875544025129600:12345-0@lo:103: 00010000:00010000:0.0:1788658336.882615:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658336.882619:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e765 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e75e expref: 22 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882628:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e75e expref: 22 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882637:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e75e expref: 22 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882646:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658336.882666:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3650:x1875544025129600:12345-0@lo:103: Request processed in 59us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658336.882672:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788658336.882684:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658336.882690:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:3648:x1875544025128832:12345-0@lo:103: 00010000:00010000:0.0:1788658336.882737:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658336.882743:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b96600/0x48e67cc629c6e830 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e829 expref: 20 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882750:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b96600/0x48e67cc629c6e830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e829 expref: 20 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882759:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96600/0x48e67cc629c6e830 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e829 expref: 20 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882768:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658336.882797:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:3648:x1875544025128832:12345-0@lo:103: Request processed in 108us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658336.882803:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658336.882815:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658336.882820:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:3648:x1875544025129344:12345-0@lo:103: 00010000:00010000:0.0:1788658336.882827:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658336.882831:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e7ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e7c7 expref: 18 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882838:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e7ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e7c7 expref: 18 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882847:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6e7ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e7c7 expref: 18 pid: 6531 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.882857:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658336.882877:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3648:x1875544025129344:12345-0@lo:103: Request processed in 58us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658336.882882:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658336.882929:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025128832:0@lo:103: 00000100:00100000:0.0:1788658336.882938:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025129344:0@lo:103: 00000100:00100000:1.0:1788658336.883175:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025129088:0@lo:103: 00000100:00100000:1.0:1788658336.883183:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025129600:0@lo:103: 00000100:00100000:3.0:1788658336.883583:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025128960:0@lo:103: 00000100:00100000:3.0:1788658336.883594:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025129472:0@lo:103: 00000100:00100000:3.0:1788658336.884274:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658336.884866:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025129472 00000100:00100000:1.0:1788658336.884877:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025129472 00010000:00010000:1.0:1788658336.884924:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e78f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e788 expref: 17 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658336.884992:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658336.885003:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84dba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:3649:x1875544025129472:12345-0@lo:103: 00010000:00010000:1.0:1788658336.885020:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658336.885026:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e78f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e788 expref: 17 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.885038:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e78f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e788 expref: 17 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.885058:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6e78f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e788 expref: 17 pid: 6529 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658336.885088:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658336.885136:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84dba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:3649:x1875544025129472:12345-0@lo:103: Request processed in 134us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658336.885143:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788658336.885612:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025129472:0@lo:103: 00000100:00100000:0.0:1788658336.885954:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127168:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658336.885965:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10348:1875544025127296:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658336.886016:0:10348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.886225:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025128704:0@lo:103: 00000100:00100000:2.0:1788658336.886238:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025129216:0@lo:103: 00000100:00100000:2.0:1788658336.886294:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658336.886596:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025129216 00000100:00100000:0.0:1788658336.886603:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025129216 00010000:00010000:0.0:1788658336.886635:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c6e7dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e7d5 expref: 16 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658336.886668:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788658336.886676:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:3647:x1875544025129216:12345-0@lo:103: 00010000:00010000:0.0:1788658336.886687:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658336.886692:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c6e7dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e7d5 expref: 16 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.886729:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c6e7dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e7d5 expref: 16 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.886746:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391c00/0x48e67cc629c6e7dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e7d5 expref: 16 pid: 6530 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.886772:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658336.886811:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:3647:x1875544025129216:12345-0@lo:103: Request processed in 135us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658336.886817:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658336.887036:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025129216:0@lo:103: 00000100:00100000:0.0:1788658336.887160:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658336.887193:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658336.887254:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000959104 00000100:00100000:2.0:1788658336.887259:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000959104 00010000:00010000:2.0:1788658336.887278:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e88b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5c0 expref: 10 pid: 6531 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.887300:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000959232 00000100:00100000:2.0:1788658336.887302:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000959232 00010000:00010000:2.0:1788658336.887313:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5b9 expref: 11 pid: 6531 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658336.887324:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:2.0:1788658336.887329:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:552b02cf-e822-4974-bfd4-4217116bc45f+11:2396:x1875544000959104:12345-192.168.202.53@tcp:103: 00010000:00010000:2.0:1788658336.887343:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658336.887347:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e88b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5c0 expref: 11 pid: 6531 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.887357:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e88b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5c0 expref: 11 pid: 6531 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.887368:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80030200/0x48e67cc629c6e88b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5c0 expref: 11 pid: 6531 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658336.887478:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:0.0:1788658336.887486:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:552b02cf-e822-4974-bfd4-4217116bc45f+10:2396:x1875544000959232:12345-192.168.202.53@tcp:103: 00010000:00010000:0.0:1788658336.887493:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658336.887498:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e884 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5b9 expref: 10 pid: 6531 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887507:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e884 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5b9 expref: 10 pid: 6531 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887517:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80031e00/0x48e67cc629c6e884 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5b9 expref: 10 pid: 6531 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887534:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887544:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887559:0:9539:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887567:0:9539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887574:0:9539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887581:0:9539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887597:0:9539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658336.887602:0:9539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887611:0:9539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887625:0:9539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887635:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658336.887677:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:552b02cf-e822-4974-bfd4-4217116bc45f+9:2396:x1875544000959232:12345-192.168.202.53@tcp:103: Request processed in 192us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658336.887683:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00010000:00010000:0.0:1788658336.887730:0:10348:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887739:0:10348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658336.887745:0:10348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e8ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10348 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658336.888741:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658336.888796:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:552b02cf-e822-4974-bfd4-4217116bc45f+8:2396:x1875544000959104:12345-192.168.202.53@tcp:103: Request processed in 1461us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658336.888805:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00010000:00010000:1.0:1788658337.215043:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658337.269142:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658337.269277:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000959360 00000100:00100000:1.0:1788658337.269292:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000959360 00000100:00100000:1.0:1788658337.269367:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 199 00000100:00100000:1.0:1788658337.269379:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+8:6171:x1875544000959360:12345-192.168.202.53@tcp:101: 00010000:00010000:1.0:1788658337.269400:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658337.269438:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c6e8d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc630 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.269475:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c6e8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc630 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.269512:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c6e8d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc630 expref: 9 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658337.269524:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b3600, rc 0) 00000100:00100000:1.0:1788658337.269605:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+9:6171:x1875544000959360:12345-192.168.202.53@tcp:101: Request processed in 227us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.269613:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 199 00000100:00100000:3.0:1788658337.276378:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658337.276596:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000959488 00000100:00100000:0.0:1788658337.276609:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000959488 00000100:00100000:0.0:1788658337.276688:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:0.0:1788658337.276746:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+9:6171:x1875544000959488:12345-192.168.202.53@tcp:501: 00000100:00100000:0.0:1788658337.276955:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+9:6171:x1875544000959488:12345-192.168.202.53@tcp:501: Request processed in 257us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.276983:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:3.0:1788658337.281113:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658337.283477:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000959616 00000100:00100000:0.0:1788658337.283500:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000959616 00000100:00100000:0.0:1788658337.283658:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 201 00000100:00100000:0.0:1788658337.283672:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+9:6171:x1875544000959616:12345-192.168.202.53@tcp:503: 00000100:00100000:0.0:1788658337.284263:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+9:6171:x1875544000959616:12345-192.168.202.53@tcp:503: Request processed in 591us (3174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.284273:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 201 00000100:00100000:2.0:1788658337.291518:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658337.291631:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000959744 00000100:00100000:0.0:1788658337.291644:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000959744 00000100:00100000:0.0:1788658337.291747:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:0.0:1788658337.291761:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+9:6646:x1875544000959744:12345-192.168.202.53@tcp:502: 00000100:00100000:0.0:1788658337.291987:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+9:6646:x1875544000959744:12345-192.168.202.53@tcp:502: Request processed in 229us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.291996:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:2.0:1788658337.303964:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658337.304240:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000959872 00000100:00100000:0.0:1788658337.304255:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000959872 00000100:00100000:0.0:1788658337.304393:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 203 00000100:00100000:0.0:1788658337.304407:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+9:6646:x1875544000959872:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658337.304628:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+9:6646:x1875544000959872:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 224us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.304637:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 203 00000100:00100000:3.0:1788658337.310561:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658337.315986:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000960000 00000100:00100000:2.0:1788658337.316019:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000960000 00000100:00100000:2.0:1788658337.316122:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 204 00000100:00100000:2.0:1788658337.316136:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+9:6171:x1875544000960000:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658337.316159:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658337.316185:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e8d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc637 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.316223:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e8d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc637 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.316237:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e8d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc637 expref: 10 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658337.316270:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391e00, rc 0) 00000100:00100000:2.0:1788658337.316376:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:6171:x1875544000960000:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 243us (5830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.316384:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 204 00000100:00100000:2.0:1788658337.322461:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658337.322671:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000960128 00000100:00100000:0.0:1788658337.322684:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000960128 00000100:00100000:0.0:1788658337.322807:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 205 00000100:00100000:1.0:1788658337.322927:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:6171:x1875544000960128:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658337.323466:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:6171:x1875544000960128:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 628us (1015us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658337.323477:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 205 00000100:00100000:2.0:1788658337.728415:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025130112:0@lo:400: 00000100:00100000:2.0:1788658337.728512:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.728588:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025130624:0@lo:400: 00000100:00100000:2.0:1788658337.728616:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.728645:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788658337.728651:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025129984:0@lo:400: 00000100:00100000:2.0:1788658337.728678:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.728736:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025130496:0@lo:400: 00000100:00100000:2.0:1788658337.728760:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.728778:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025131136:0@lo:400: 00000100:00100000:2.0:1788658337.728797:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.728817:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658337.728822:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025131008:0@lo:400: 00000100:00100000:2.0:1788658337.728846:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.728874:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025130624 00000100:00100000:1.0:1788658337.728874:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025130112 00000100:00100000:1.0:1788658337.728882:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025130112 00000100:00100000:2.0:1788658337.728883:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025130624 00000100:00100000:2.0:1788658337.728939:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025130496 00000100:00100000:2.0:1788658337.728942:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025130496 00000100:00100000:2.0:1788658337.728955:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025131136 00000100:00100000:2.0:1788658337.728958:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025131136 00000100:00100000:2.0:1788658337.728990:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658337.729000:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025130624:12345-0@lo:400: 00000100:00100000:0.0:1788658337.729042:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025129856:0@lo:400: 00000100:00100000:2.0:1788658337.729059:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025130624:12345-0@lo:400: Request processed in 60us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.729067:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788658337.729072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.729088:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658337.729089:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025130368:0@lo:400: 00000100:00100000:2.0:1788658337.729094:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025130496:12345-0@lo:400: 00000100:00100000:0.0:1788658337.729108:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.729117:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025130496:12345-0@lo:400: Request processed in 23us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658337.729123:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658337.729126:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025130880:0@lo:13: 00000100:00100000:2.0:1788658337.729133:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788658337.729138:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025131136:12345-0@lo:400: 00000100:00100000:0.0:1788658337.729148:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.729160:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025131136:12345-0@lo:400: Request processed in 22us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.729164:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788658337.729165:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658337.729170:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025129728:0@lo:400: 00000100:00100000:0.0:1788658337.729189:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.729203:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025130240:0@lo:400: 00010000:00080000:2.0:1788658337.729206:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f4e00 x1875544025131136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658337.729221:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658337.729222:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025131136:0@lo:400: 00000100:00100000:0.0:1788658337.729229:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025130752:0@lo:400: 00010000:00080000:2.0:1788658337.729233:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f7800 x1875544025130496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658337.729241:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025130496:0@lo:400: 00000100:00100000:0.0:1788658337.729245:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.729253:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025131264:0@lo:400: 00000100:00100000:0.0:1788658337.729272:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658337.729296:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025131264 00000100:00100000:0.0:1788658337.729300:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025131264 00000100:00100000:0.0:1788658337.729327:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658337.729334:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025131264:12345-0@lo:400: 00000100:00100000:0.0:1788658337.729367:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025131264:12345-0@lo:400: Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.729373:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658337.729408:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025129984 00000100:00100000:0.0:1788658337.729412:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025129984 00000100:00100000:0.0:1788658337.729429:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025131008 00000100:00100000:0.0:1788658337.729432:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025131008 00000100:00100000:0.0:1788658337.729443:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025130368 00000100:00100000:0.0:1788658337.729452:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025130368 00000100:00100000:0.0:1788658337.729465:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025129728 00000100:00100000:0.0:1788658337.729467:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025129728 00000100:00100000:0.0:1788658337.729478:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025130240 00000100:00100000:0.0:1788658337.729480:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025130240 00000100:00100000:0.0:1788658337.729491:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025130752 00000100:00100000:0.0:1788658337.729493:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025130752 00000100:00100000:0.0:1788658337.729506:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788658337.729511:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025129984:12345-0@lo:400: 00000100:00100000:0.0:1788658337.729546:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025129984:12345-0@lo:400: Request processed in 35us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.729551:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788658337.729561:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788658337.729567:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025131008:12345-0@lo:400: 00000100:00100000:0.0:1788658337.729590:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025131008:12345-0@lo:400: Request processed in 24us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.729594:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788658337.729603:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788658337.729608:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025130368:12345-0@lo:400: 00000100:00100000:0.0:1788658337.729632:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025130368:12345-0@lo:400: Request processed in 24us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.729636:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788658337.729645:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788658337.729649:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025129728:12345-0@lo:400: 00000100:00100000:0.0:1788658337.729671:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025129728:12345-0@lo:400: Request processed in 22us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.729676:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788658337.729685:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788658337.729697:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025130240:12345-0@lo:400: 00000100:00100000:0.0:1788658337.729756:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025130240:12345-0@lo:400: Request processed in 60us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.729763:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788658337.729774:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788658337.729780:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025130752:12345-0@lo:400: 00000100:00100000:0.0:1788658337.729802:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025130752:12345-0@lo:400: Request processed in 23us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.729807:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788658337.729977:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025129728:0@lo:400: 00000100:00100000:0.0:1788658337.729988:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025130240:0@lo:400: 00000100:00100000:0.0:1788658337.729997:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025130752:0@lo:400: 00010000:00080000:0.0:1788658337.730007:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f5f80 x1875544025131264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658337.730017:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025131264:0@lo:400: 00010000:00080000:0.0:1788658337.730028:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f7100 x1875544025130368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658337.730035:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025130368:0@lo:400: 00010000:00080000:2.0:1788658337.730405:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f6d80 x1875544025130624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658337.730417:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025130624:0@lo:400: 00010000:00080000:2.0:1788658337.730447:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f4a80 x1875544025131008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658337.730468:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025131008:0@lo:400: 00000100:00100000:2.0:1788658337.730483:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025129984:0@lo:400: 00000100:00100000:1.0:1788658337.730911:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025129856 00000100:00100000:1.0:1788658337.730920:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025129856 00000100:00100000:1.0:1788658337.730939:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788658337.730948:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025130112:12345-0@lo:400: 00000100:00100000:1.0:1788658337.731022:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025130112:12345-0@lo:400: Request processed in 74us (2509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.731029:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788658337.731045:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788658337.731052:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025129856:12345-0@lo:400: 00000100:00100000:1.0:1788658337.731088:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025129856:12345-0@lo:400: Request processed in 37us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658337.731094:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788658337.731148:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025129856:0@lo:400: 00000100:00100000:1.0:1788658337.731225:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658337.731239:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025131392:0@lo:13: 00000100:00080000:3.0:1788658337.731258:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658337.731265:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658337.731268:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658337.731270:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658337.731274:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658337.731291:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025130880 00000100:00100000:3.0:1788658337.731302:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025130880 00000100:00100000:1.0:1788658337.731326:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025131392 00000100:00100000:3.0:1788658337.731329:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788658337.731330:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025131392 00000100:00100000:3.0:1788658337.731336:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025130880:12345-0@lo:13: 00002000:00000024:3.0:1788658337.731362:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658337.731411:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025130880:12345-0@lo:13: Request processed in 76us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658337.731417:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658337.731432:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658337.731438:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025131392:12345-0@lo:13: 00002000:00000024:3.0:1788658337.731447:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658337.731478:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025131392:12345-0@lo:13: Request processed in 40us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658337.731483:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788658337.731507:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f6300 x1875544025131392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658337.731522:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025131392:0@lo:13: 00010000:00080000:1.0:1788658337.734314:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f3b80 x1875544025130880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658337.734348:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025130880:0@lo:13: 00000100:00100000:0.0:1788658337.734910:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025130112:0@lo:400: 00000100:00100000:3.0:1788658337.978464:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658337.978512:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658337.978558:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658337.978600:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000960256 00000100:00100000:3.0:1788658337.978603:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658337.978618:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000960256 00000100:00100000:3.0:1788658337.978668:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000960512 00000100:00100000:3.0:1788658337.978679:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000960512 00000100:00100000:3.0:1788658337.978781:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000960640 00000100:00100000:3.0:1788658337.978786:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000960640 00000100:00100000:1.0:1788658337.978821:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:1.0:1788658337.978846:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000960512:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658337.978949:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000960512:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 109us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.979045:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000960384 00000100:00100000:0.0:1788658337.979050:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000960384 00000100:00100000:0.0:1788658337.979077:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:0.0:1788658337.979103:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544000960256:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658337.979136:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544000960256:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 35us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.979143:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:0.0:1788658337.979165:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:0.0:1788658337.979171:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000960384:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658337.979194:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000960384:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658337.979199:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:0.0:1788658337.979244:0:8453:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788658337.979254:0:8453:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1788658337.979922:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658337.979929:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658337.979931:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658337.979934:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658337.981174:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:3.0:1788658337.981194:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000960640:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658337.981278:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000960640:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 92us (2677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658337.981299:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1788658337.988095:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00010000:00010000:2.0:1788658338.239269:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658338.239727:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658338.239775:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025131520:0@lo:13: 00000100:00100000:0.0:1788658338.239868:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.240848:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658338.240870:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025131648:0@lo:13: 00000100:00100000:1.0:1788658338.240926:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.240977:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025131520 00000100:00100000:1.0:1788658338.241002:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025131520 00000100:00100000:1.0:1788658338.241048:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025131648 00000100:00100000:1.0:1788658338.241051:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025131648 00000100:00100000:1.0:1788658338.241068:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658338.241077:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025131520:12345-0@lo:13: 00002000:00000024:1.0:1788658338.241113:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658338.241161:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025131520:12345-0@lo:13: Request processed in 84us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.241187:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658338.241210:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658338.241218:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025131648:12345-0@lo:13: 00002000:00000024:1.0:1788658338.241228:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658338.241276:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025131648:12345-0@lo:13: Request processed in 58us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.241283:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788658338.241934:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2251880 x1875544025131520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658338.241960:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025131520:0@lo:13: 00010000:00080000:2.0:1788658338.242071:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f0000 x1875544025131648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658338.242086:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025131648:0@lo:13: 00000100:00100000:1.0:1788658338.753315:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658338.753348:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025131776:0@lo:41: 00000100:00100000:1.0:1788658338.753433:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.753528:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025131776 00000100:00100000:1.0:1788658338.753538:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025131776 00000100:00100000:1.0:1788658338.753596:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788658338.753606:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025131776:12345-0@lo:41: 00000004:00000024:1.0:1788658338.753651:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788658338.753738:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025131776:12345-0@lo:41: Request processed in 132us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.753748:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788658338.753800:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025131776:0@lo:41: 10000000:01000000:3.0:1788658338.816509:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788658338.816522:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1d8230c000 from 48 10000000:01000000:3.0:1788658338.816529:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788658338.816594:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.816609:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.816624:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658338.816658:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025131904:0@lo:101: 00000100:00100000:3.0:1788658338.816799:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658338.816862:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658338.817819:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025131904 00000100:00100000:2.0:1788658338.817833:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025131904 00000100:00100000:2.0:1788658338.817894:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788658338.817904:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+15:6534:x1875544025131904:12345-0@lo:101: 00010000:00010000:2.0:1788658338.817921:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658338.817942:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e8e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e8df expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658338.817974:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e8df expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658338.817989:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e8e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e8df expref: 16 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658338.818000:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390c00, rc 0) 00000100:00100000:2.0:1788658338.818079:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025131904:12345-0@lo:101: Request processed in 175us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658338.818108:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788658338.818175:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025131904:0@lo:101: 00010000:00010000:2.0:1788658338.818195:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658338.818206:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658338.818296:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025132032:0@lo:501: 00000100:00100000:2.0:1788658338.818332:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658338.818357:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.818556:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025132032 00000100:00100000:1.0:1788658338.818561:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025132032 00000100:00100000:1.0:1788658338.818599:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788658338.818607:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025132032:12345-0@lo:501: 00000100:00100000:1.0:1788658338.818779:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025132032:12345-0@lo:501: Request processed in 173us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.818796:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788658338.819261:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025132032:0@lo:501: 00000100:00100000:2.0:1788658338.819300:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025132160:0@lo:503: 00000100:00100000:2.0:1788658338.819498:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658338.819538:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.820542:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025132160 00000100:00100000:1.0:1788658338.820571:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025132160 00000100:00100000:1.0:1788658338.820629:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788658338.820639:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025132160:12345-0@lo:503: 00000100:00100000:1.0:1788658338.821484:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025132160:12345-0@lo:503: Request processed in 840us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.821497:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788658338.821675:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025132160:0@lo:503: 00000100:00100000:3.0:1788658338.822614:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10380:1875544025132288:0@lo:502: 00000100:00100000:3.0:1788658338.822695:0:10380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658338.824528:0:10380:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.824748:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025132288 00000100:00100000:1.0:1788658338.824771:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025132288 00000100:00100000:1.0:1788658338.824853:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788658338.824865:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:10380:x1875544025132288:12345-0@lo:502: 00000100:00100000:1.0:1788658338.825073:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:10380:x1875544025132288:12345-0@lo:502: Request processed in 210us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.825081:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788658338.825098:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10380:1875544025132288:0@lo:502: 00000100:00100000:2.0:1788658338.825182:0:10380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10380:1875544025132416:0@lo:502: 00000100:00100000:2.0:1788658338.825250:0:10380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658338.825892:0:10380:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658338.829001:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025132416 00000100:00100000:3.0:1788658338.829023:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025132416 00000100:00100000:3.0:1788658338.829100:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788658338.829112:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:10380:x1875544025132416:12345-0@lo:502: 00000100:00100000:3.0:1788658338.830132:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:10380:x1875544025132416:12345-0@lo:502: Request processed in 1016us (4875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658338.830146:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788658338.830456:0:10380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10380:1875544025132416:0@lo:502: 00000040:00080000:2.0:1788658338.830505:0:10380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788658338.830755:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788658338.831270:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788658338.831287:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.831312:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658338.831732:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788658338.831737:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788658338.831741:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788658338.831950:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.831962:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.831975:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658338.832005:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025132544:0@lo:101: 00000100:00100000:3.0:1788658338.832090:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658338.832143:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658338.832754:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025132544 00000100:00100000:2.0:1788658338.832774:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025132544 00000100:00100000:2.0:1788658338.832866:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788658338.832878:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+16:6534:x1875544025132544:12345-0@lo:101: 00010000:00010000:2.0:1788658338.832897:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658338.832918:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391200/0x48e67cc629c6e8f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e8ed expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658338.832962:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391200/0x48e67cc629c6e8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e8ed expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658338.832973:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391200/0x48e67cc629c6e8f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e8ed expref: 17 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658338.832985:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391200, rc 0) 00000100:00100000:2.0:1788658338.833066:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025132544:12345-0@lo:101: Request processed in 190us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658338.833073:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788658338.833086:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025132544:0@lo:101: 00010000:00010000:3.0:1788658338.833104:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.833115:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658338.833209:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025132672:0@lo:501: 00000100:00100000:3.0:1788658338.833239:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658338.833270:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.833581:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025132672 00000100:00100000:1.0:1788658338.833587:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025132672 00000100:00100000:1.0:1788658338.833655:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788658338.833664:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025132672:12345-0@lo:501: 00000100:00100000:1.0:1788658338.833877:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025132672:12345-0@lo:501: Request processed in 214us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.833885:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788658338.837919:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025132672:0@lo:501: 00000100:00100000:1.0:1788658338.838007:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025132800:0@lo:503: 00000100:00100000:1.0:1788658338.838104:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.838150:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658338.838193:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025132800 00000100:00100000:2.0:1788658338.838202:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025132800 00000100:00100000:2.0:1788658338.838274:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788658338.838286:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025132800:12345-0@lo:503: 00000100:00100000:2.0:1788658338.838446:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025132800:12345-0@lo:503: Request processed in 162us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658338.838455:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788658338.838499:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025132800:0@lo:503: 00000100:00100000:3.0:1788658338.845733:0:10381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10381:1875544025132928:0@lo:502: 00000100:00100000:3.0:1788658338.845867:0:10381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658338.845924:0:10381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.845948:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025132928 00000100:00100000:1.0:1788658338.845965:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025132928 00000100:00100000:1.0:1788658338.846029:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788658338.846051:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:10381:x1875544025132928:12345-0@lo:502: 00000100:00100000:1.0:1788658338.846231:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:10381:x1875544025132928:12345-0@lo:502: Request processed in 192us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.846239:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788658338.846363:0:10381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10381:1875544025132928:0@lo:502: 00000020:01000000:0.0:1788658338.846399:0:10381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658338.846411:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658338.846414:0:10381:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788658338.846422:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788658338.846449:0:10381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10381:1875544025133056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658338.846486:0:10381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658338.846513:0:10381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658338.846682:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025133056 00000100:00100000:3.0:1788658338.846688:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025133056 00000100:00100000:3.0:1788658338.846812:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788658338.846820:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:10381:x1875544025133056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658338.846912:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:10381:x1875544025133056:12345-0@lo:502:llog_process_th.0 Request processed in 92us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658338.846919:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788658338.847993:0:10381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10381:1875544025133056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658338.848034:0:10381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658338.848041:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658338.848044:0:10381:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788658338.848050:0:10381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788658338.848174:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788658338.848198:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788658338.848211:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.848225:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658338.848236:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788658338.848240:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ebd8b1800 from 48 10000000:01000000:1.0:1788658338.848242:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788658338.848357:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.848367:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.848378:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.848401:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025133184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.848458:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.848504:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658338.848644:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025133184 00000100:00100000:3.0:1788658338.848652:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025133184 00000100:00100000:3.0:1788658338.848728:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788658338.848738:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+17:6534:x1875544025133184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658338.848754:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658338.848780:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c6e902 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e8fb expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.848808:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c6e902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e8fb expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.848820:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c6e902 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e8fb expref: 18 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.848846:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96000, rc 0) 00000100:00100000:3.0:1788658338.848893:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025133184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658338.848900:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788658338.850588:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025133184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658338.850623:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658338.850639:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658338.850785:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025133312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658338.850949:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658338.850996:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.853747:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025133312 00000100:00100000:1.0:1788658338.853803:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025133312 00000100:00100000:1.0:1788658338.853894:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788658338.853908:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025133312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.854442:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025133312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 536us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.854452:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788658338.859514:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025133312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658338.859622:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025133440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658338.859784:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658338.859836:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.859911:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025133440 00000100:00100000:1.0:1788658338.859922:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025133440 00000100:00100000:1.0:1788658338.859995:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788658338.860008:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025133440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.860177:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025133440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.860186:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788658338.860466:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025133440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658338.861329:0:10384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10384:1875544025133568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658338.861387:0:10384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658338.861425:0:10384:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.862101:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025133568 00000100:00100000:1.0:1788658338.862111:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025133568 00000100:00100000:1.0:1788658338.862175:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788658338.862186:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:10384:x1875544025133568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.862347:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:10384:x1875544025133568:12345-0@lo:502:llog_process_th.0 Request processed in 162us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.862355:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788658338.863417:0:10384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10384:1875544025133568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658338.863512:0:10384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10384:1875544025133696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658338.863587:0:10384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658338.863851:0:10384:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658338.864057:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025133696 00000100:00100000:3.0:1788658338.864066:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025133696 00000100:00100000:3.0:1788658338.864127:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788658338.864139:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:10384:x1875544025133696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658338.864341:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:10384:x1875544025133696:12345-0@lo:502:llog_process_th.0 Request processed in 203us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658338.864349:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788658338.867894:0:10384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10384:1875544025133696:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788658338.868350:0:10384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788658338.868595:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788658338.868631:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788658338.868646:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658338.868660:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658338.868672:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788658338.868676:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788658338.868679:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788658338.869679:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.869694:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.869728:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.869789:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025133824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.869885:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.869941:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658338.869951:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025133824 00000100:00100000:0.0:1788658338.869962:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025133824 00000100:00100000:0.0:1788658338.870128:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788658338.870141:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+18:6534:x1875544025133824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658338.870161:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658338.870177:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e909 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658338.870207:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e909 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658338.870220:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e909 expref: 19 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658338.870231:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d0a00, rc 0) 00000100:00100000:0.0:1788658338.870293:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025133824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658338.870307:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788658338.870495:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025133824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658338.870514:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.870525:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.870603:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025133952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.870630:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.870645:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.870662:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025133952 00000100:00100000:1.0:1788658338.870666:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025133952 00000100:00100000:1.0:1788658338.870692:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788658338.870700:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025133952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.871002:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025133952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.871010:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788658338.871043:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025133952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.871139:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025134080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.871184:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.871198:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.871216:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025134080 00000100:00100000:1.0:1788658338.871220:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025134080 00000100:00100000:1.0:1788658338.871242:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788658338.871248:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025134080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.871488:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025134080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.871495:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788658338.871561:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025134080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.872167:0:10385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10385:1875544025134208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.872211:0:10385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.872293:0:10385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f2600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658338.872603:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025134208 00000100:00100000:0.0:1788658338.872610:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025134208 00000100:00100000:0.0:1788658338.873029:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788658338.873150:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:10385:x1875544025134208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.873410:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:10385:x1875544025134208:12345-0@lo:502:llog_process_th.0 Request processed in 370us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.873418:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788658338.873506:0:10385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10385:1875544025134208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658338.873543:0:10385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658338.873555:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658338.873557:0:10385:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788658338.873565:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788658338.873602:0:10385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10385:1875544025134336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658338.873649:0:10385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658338.873753:0:10385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.873870:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025134336 00000100:00100000:1.0:1788658338.873876:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025134336 00000100:00100000:1.0:1788658338.874018:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788658338.874029:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:10385:x1875544025134336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.874126:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:10385:x1875544025134336:12345-0@lo:502:llog_process_th.0 Request processed in 99us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.874133:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788658338.874252:0:10385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10385:1875544025134336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658338.874335:0:10385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658338.874341:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658338.874343:0:10385:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788658338.874348:0:10385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788658338.874438:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788658338.874461:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788658338.874473:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658338.874485:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658338.874497:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788658338.874507:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ec11f4800 from 48 10000000:01000000:0.0:1788658338.874511:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658338.874541:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658338.874550:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658338.874560:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658338.874573:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025134464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658338.874600:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658338.874619:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.874829:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025134464 00000100:00100000:1.0:1788658338.874833:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025134464 00000100:00100000:1.0:1788658338.874885:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788658338.874893:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:6534:x1875544025134464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658338.874903:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658338.874921:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b3a00/0x48e67cc629c6e91e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e917 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.874956:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b3a00/0x48e67cc629c6e91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e917 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.874967:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b3a00/0x48e67cc629c6e91e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e917 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.874977:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b3a00, rc 0) 00000100:00100000:1.0:1788658338.875007:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025134464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.875013:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788658338.875172:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025134464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658338.875186:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.875195:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.875255:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025134592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.875341:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.875392:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658338.875422:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025134592 00000100:00100000:0.0:1788658338.875426:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025134592 00000100:00100000:0.0:1788658338.875485:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788658338.875493:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025134592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658338.875608:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025134592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658338.875615:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788658338.875668:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025134592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.875698:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025134720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.875781:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.875795:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.875815:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025134720 00000100:00100000:1.0:1788658338.875818:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025134720 00000100:00100000:1.0:1788658338.875838:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788658338.875844:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025134720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.875918:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025134720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.875925:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788658338.876144:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025134720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.876424:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10387:1875544025134848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.876461:0:10387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.876485:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025134848 00000100:00100000:1.0:1788658338.876488:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025134848 00000100:00100000:1.0:1788658338.876512:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788658338.876519:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:10387:x1875544025134848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.876596:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:10387:x1875544025134848:12345-0@lo:502:llog_process_th.0 Request processed in 77us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.876603:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788658338.876646:0:10387:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.876658:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10387:1875544025134848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.876694:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10387:1875544025134976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.876758:0:10387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.876792:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025134976 00000100:00100000:1.0:1788658338.876795:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025134976 00000100:00100000:1.0:1788658338.876813:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788658338.876820:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:10387:x1875544025134976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.876884:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:10387:x1875544025134976:12345-0@lo:502:llog_process_th.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.876891:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788658338.876917:0:10387:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.876928:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10387:1875544025134976:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788658338.877196:0:10387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788658338.877280:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788658338.877302:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788658338.877314:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.877327:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658338.877339:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788658338.877342:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1788658338.877346:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788658338.877375:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.877385:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.877395:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.877412:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025135104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.877442:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.877467:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.877481:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025135104 00000100:00100000:1.0:1788658338.877485:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025135104 00000100:00100000:1.0:1788658338.877508:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788658338.877515:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025135104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658338.877525:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658338.877538:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b2a00/0x48e67cc629c6e92c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e925 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.877564:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b2a00/0x48e67cc629c6e92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e925 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.877574:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b2a00/0x48e67cc629c6e92c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e925 expref: 21 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.877583:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2a00, rc 0) 00000100:00100000:1.0:1788658338.877613:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025135104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.877619:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788658338.877650:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025135104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658338.877663:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.877673:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.878151:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025135232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.878183:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.878207:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.878223:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025135232 00000100:00100000:1.0:1788658338.878228:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025135232 00000100:00100000:1.0:1788658338.878249:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788658338.878256:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025135232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.878386:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025135232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.878393:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788658338.878426:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025135232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.878453:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025135360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.878493:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.878507:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.878519:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025135360 00000100:00100000:1.0:1788658338.878522:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025135360 00000100:00100000:1.0:1788658338.878538:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788658338.878543:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025135360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.878617:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025135360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.878624:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788658338.878662:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025135360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658338.881733:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10388:1875544025135488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658338.882509:0:10388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658338.882567:0:10388:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.882577:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025135488 00000100:00100000:1.0:1788658338.882590:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025135488 00000100:00100000:1.0:1788658338.882659:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788658338.882671:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:10388:x1875544025135488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.883004:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:10388:x1875544025135488:12345-0@lo:502:llog_process_th.0 Request processed in 334us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.883020:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788658338.883490:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10388:1875544025135488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788658338.883534:0:10388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658338.883545:0:10388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658338.883548:0:10388:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788658338.883557:0:10388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788658338.883598:0:10388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10388:1875544025135616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658338.883642:0:10388:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658338.883680:0:10388:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.883867:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025135616 00000100:00100000:1.0:1788658338.883874:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025135616 00000100:00100000:1.0:1788658338.883915:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788658338.883925:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:10388:x1875544025135616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.884039:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:10388:x1875544025135616:12345-0@lo:502:llog_process_th.0 Request processed in 115us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.884056:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788658338.884069:0:10388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10388:1875544025135616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658338.884094:0:10388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658338.884099:0:10388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658338.884100:0:10388:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788658338.884104:0:10388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788658338.885391:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788658338.885430:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788658338.885443:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.885456:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658338.885469:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788658338.885472:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1ec1212800 from 48 10000000:01000000:1.0:1788658338.885475:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788658338.885520:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.885529:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.885541:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.885565:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025135744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.885639:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.885693:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658338.890794:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025135744 00000100:00100000:2.0:1788658338.890814:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025135744 00000100:00100000:2.0:1788658338.890898:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788658338.890912:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025135744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658338.890935:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658338.890961:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e93a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e933 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658338.890998:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e933 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658338.891011:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e933 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658338.891021:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391600, rc 0) 00000100:00100000:2.0:1788658338.891135:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025135744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (5495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658338.891143:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788658338.891172:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025135744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658338.891199:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.891212:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.891324:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025135872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.891369:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.891450:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658338.891549:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025135872 00000100:00100000:0.0:1788658338.891554:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025135872 00000100:00100000:0.0:1788658338.891624:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788658338.891634:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025135872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658338.891833:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025135872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658338.891840:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788658338.891980:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025135872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.892013:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025136000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.892064:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.892085:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96240 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.892097:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025136000 00000100:00100000:1.0:1788658338.892100:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025136000 00000100:00100000:1.0:1788658338.892121:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788658338.892127:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025136000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.892210:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025136000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.892217:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788658338.892259:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025136000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.892594:0:10389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10389:1875544025136128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.892633:0:10389:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.892651:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025136128 00000100:00100000:1.0:1788658338.892654:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025136128 00000100:00100000:1.0:1788658338.892672:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788658338.892678:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:10389:x1875544025136128:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.892848:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:10389:x1875544025136128:12345-0@lo:502:llog_process_th.0 Request processed in 170us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.892855:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788658338.892883:0:10389:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.892895:0:10389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10389:1875544025136128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.892995:0:10389:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10389:1875544025136256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.893029:0:10389:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.893048:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025136256 00000100:00100000:1.0:1788658338.893052:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025136256 00000100:00100000:1.0:1788658338.893069:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788658338.893074:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:10389:x1875544025136256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658338.893129:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:10389:x1875544025136256:12345-0@lo:502:llog_process_th.0 Request processed in 54us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.893136:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788658338.893162:0:10389:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.893174:0:10389:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10389:1875544025136256:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788658338.893192:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788658338.893248:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788658338.893405:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788658338.893417:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.893437:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658338.893448:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788658338.893452:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788658338.893455:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788658338.893486:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.893495:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.893505:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.893519:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025136384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.893552:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.893571:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.893830:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025136384 00000100:00100000:1.0:1788658338.893836:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025136384 00000100:00100000:1.0:1788658338.893859:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788658338.893866:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025136384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658338.893877:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658338.893890:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b2200/0x48e67cc629c6e948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e941 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.893913:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b2200/0x48e67cc629c6e948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e941 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.893950:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b2200/0x48e67cc629c6e948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e941 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.893961:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2200, rc 0) 00000100:00100000:1.0:1788658338.893999:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025136384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.894005:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788658338.894073:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025136384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658338.894086:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.894096:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.894154:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025136512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.894184:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.894200:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.894213:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025136512 00000100:00100000:1.0:1788658338.894216:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025136512 00000100:00100000:1.0:1788658338.894234:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788658338.894241:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025136512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.894364:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025136512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.894370:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788658338.894396:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025136512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.894430:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025136640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.894464:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.894477:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.894489:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025136640 00000100:00100000:1.0:1788658338.894491:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025136640 00000100:00100000:1.0:1788658338.894507:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788658338.894513:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025136640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.894589:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025136640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.894596:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788658338.894634:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025136640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658338.906039:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10391:1875544025136768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658338.906165:0:10391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658338.906227:0:10391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658338.907543:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025136768 00000100:00100000:2.0:1788658338.907559:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025136768 00000100:00100000:2.0:1788658338.907639:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788658338.907653:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:10391:x1875544025136768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658338.907909:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:10391:x1875544025136768:12345-0@lo:502:llog_process_th.0 Request processed in 259us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658338.907919:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788658338.908207:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10391:1875544025136768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658338.908251:0:10391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658338.908339:0:10391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658338.908343:0:10391:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788658338.908354:0:10391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788658338.908398:0:10391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10391:1875544025136896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658338.908446:0:10391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658338.908490:0:10391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658338.908779:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025136896 00000100:00100000:2.0:1788658338.908799:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025136896 00000100:00100000:2.0:1788658338.908849:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788658338.908859:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:10391:x1875544025136896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658338.908978:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:10391:x1875544025136896:12345-0@lo:502:llog_process_th.0 Request processed in 119us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658338.908985:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788658338.909198:0:10391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10391:1875544025136896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658338.909226:0:10391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658338.909232:0:10391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658338.909234:0:10391:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788658338.909239:0:10391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788658338.909687:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788658338.909839:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788658338.909854:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.909866:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658338.909878:0:6534:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788658338.909881:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1eae393380 from 1 10000000:01000000:1.0:1788658338.909884:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788658338.909924:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3c00/0x48e67cc629c6e94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.910221:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3c00/0x48e67cc629c6e94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.910253:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3c00/0x48e67cc629c6e94f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658338.910347:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025137024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658338.910425:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658338.910471:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2169000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658338.910495:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025137024 00000100:00100000:1.0:1788658338.910503:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025137024 00000100:00100000:1.0:1788658338.911383:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788658338.911397:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025137024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658338.911416:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658338.911436:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c6e956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e94f expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.911468:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c6e956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e94f expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.911481:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c6e956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e94f expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658338.911491:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2400, rc 0) 00000100:00100000:1.0:1788658338.911571:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025137024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658338.911579:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788658338.911677:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025137024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658338.911700:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3c00/0x48e67cc629c6e94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e956 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.911729:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3c00/0x48e67cc629c6e94f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e956 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658338.911829:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025137152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658338.911865:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658338.915646:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8217be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658338.915693:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025137152 00000100:00100000:2.0:1788658338.915734:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025137152 00000100:00100000:2.0:1788658338.915812:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788658338.915825:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025137152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658338.916010:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025137152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (4144us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658338.916020:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788658338.916293:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025137152:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788658338.916747:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788658338.916762:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3c00/0x48e67cc629c6e94f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e956 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658338.916787:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3c00/0x48e67cc629c6e94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e956 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788658339.184630:0:10411:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff427a8ac0 20000000:00000080:0.0:1788658339.184654:0:10411:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1d8267d400 uarg=0000000000000000 20000000:01000000:0.0:1788658339.184830:0:10411:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788658339.184839:0:10411:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788658339.184845:0:10411:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788658339.185470:0:10412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788658339.185676:0:10411:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788658339.199813:0:10411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788658339.199850:0:10411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788658339.199864:0:10411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788658339.199893:0:10411:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788658339.199915:0:10411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200049:0:10411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e80031800/0x48e67cc629c6e5f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e5f2 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200059:0:10411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d1200/0x48e67cc629c6e607 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e600 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200066:0:10411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c6e65b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e654 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200072:0:10411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e781 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e77a expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200082:0:10411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c6e899 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f8 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200090:0:10411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200132:0:10411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c6e899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f8 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200149:0:10411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c6e899 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f8 expref: 9 pid: 6529 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658339.200164:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10411:1875544025137280:192.168.202.53@tcp:104: 00010000:00010000:1.0:1788658339.200296:0:10411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e77a expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200315:0:10411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e781 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e77a expref: 23 pid: 6529 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658339.200325:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10411:1875544025137408:0@lo:104: 00000100:00100000:1.0:1788658339.200384:0:10411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658339.200431:0:10411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c6e65b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e654 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200440:0:10411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c6e65b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e654 expref: 23 pid: 6529 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658339.200451:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10411:1875544025137536:0@lo:104: 00000100:00100000:2.0:1788658339.200545:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025137408 00000100:00100000:1.0:1788658339.200558:0:10411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658339.200560:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025137408 00010000:00010000:1.0:1788658339.200599:0:10411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d1200/0x48e67cc629c6e607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e600 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200610:0:10411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1ec21d1200/0x48e67cc629c6e607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e600 expref: 23 pid: 6530 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658339.200620:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10411:1875544025137664:0@lo:104: 00000100:00100000:2.0:1788658339.200627:0:6520:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1788658339.200658:0:10411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e80031800/0x48e67cc629c6e5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e5f2 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.200670:0:10411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e80031800/0x48e67cc629c6e5f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e5f2 expref: 23 pid: 6530 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658339.200680:0:10411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10411:1875544025137792:0@lo:104: 00000100:00100000:2.0:1788658339.200686:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658339.200733:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025137536 00000100:00100000:2.0:1788658339.200738:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025137536 00000100:00100000:1.0:1788658339.200754:0:10411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658339.200762:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025137664 00000100:00100000:2.0:1788658339.200766:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025137664 00000100:00100000:1.0:1788658339.200794:0:10411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e85848b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658339.200799:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025137792 00000100:00100000:2.0:1788658339.200804:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025137792 00000100:00100000:2.0:1788658339.200830:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658339.200842:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:10411:x1875544025137408:12345-0@lo:104: 00010000:00010000:2.0:1788658339.200864:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.200988:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658339.200996:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:10411:x1875544025137408:12345-0@lo:104: Request processed in 156us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658339.201012:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658339.201034:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658339.201040:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:10411:x1875544025137536:12345-0@lo:104: 00010000:00010000:2.0:1788658339.201049:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201086:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788658339.201091:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:10411:x1875544025137536:12345-0@lo:104: Request processed in 53us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658339.201097:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658339.201131:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658339.201136:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:10411:x1875544025137664:12345-0@lo:104: 00010000:00010000:2.0:1788658339.201144:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201176:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788658339.201181:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:10411:x1875544025137664:12345-0@lo:104: Request processed in 46us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658339.201187:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658339.201199:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658339.201205:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:10411:x1875544025137792:12345-0@lo:104: 00010000:00010000:2.0:1788658339.201213:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391a00/0x48e67cc629c6e5f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201239:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788658339.201244:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:10411:x1875544025137792:12345-0@lo:104: Request processed in 40us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658339.201255:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788658339.201278:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788658339.201286:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201295:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658339.201300:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201310:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658339.201320:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658339.201328:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788658339.201498:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201506:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788658339.201530:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10411:1875544025137408:0@lo:104: 00010000:00010000:2.0:1788658339.201534:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201544:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6e77a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e781 expref: -99 pid: 9528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658339.201551:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10411:1875544025137536:0@lo:104: 00010000:00010000:2.0:1788658339.201568:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1788658339.201573:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10411:1875544025137664:0@lo:104: 00010000:00010000:2.0:1788658339.201574:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658339.201592:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10411:1875544025137792:0@lo:104: 00010000:00010000:2.0:1788658339.201614:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658339.201618:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201626:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658339.201634:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658339.201640:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788658339.201657:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201664:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658339.201695:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201729:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e80030a00/0x48e67cc629c6e654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e65b expref: -99 pid: 8445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201743:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658339.201746:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201753:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658339.201757:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201786:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658339.201794:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658339.201800:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788658339.201816:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201822:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658339.201828:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201834:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e80031400/0x48e67cc629c6e600 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e607 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201847:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658339.201851:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391a00/0x48e67cc629c6e5f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201856:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658339.201859:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391a00/0x48e67cc629c6e5f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201866:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391a00/0x48e67cc629c6e5f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658339.201873:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391a00/0x48e67cc629c6e5f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658339.201885:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788658339.201904:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391a00/0x48e67cc629c6e5f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201910:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658339.201916:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391a00/0x48e67cc629c6e5f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201923:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391a00/0x48e67cc629c6e5f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e5f9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.201937:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658339.201939:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658339.201940:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658339.201948:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658339.201955:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658339.201972:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025137920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658339.202021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658339.202057:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025138048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658339.202075:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658339.202084:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025138304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658339.202225:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658339.202261:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025138176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658339.202285:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658339.202400:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025137920 00000100:00100000:2.0:1788658339.202408:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025137920 00010000:00010000:2.0:1788658339.202438:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e781 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e77a expref: 24 pid: 6529 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658339.202481:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025138304 00000100:00100000:2.0:1788658339.202485:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025138304 00010000:00010000:2.0:1788658339.202500:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e80031800/0x48e67cc629c6e5f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e5f2 expref: 25 pid: 6530 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658339.202511:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025138176 00000100:00100000:2.0:1788658339.202513:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025138176 00010000:00010000:2.0:1788658339.202524:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d1200/0x48e67cc629c6e607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e600 expref: 26 pid: 6530 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658339.202536:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658339.202544:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+26:3648:x1875544025137920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658339.202557:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658339.202562:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e781 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e77a expref: 26 pid: 6529 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.202573:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e781 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e77a expref: 26 pid: 6529 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.202590:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e781 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e77a expref: 26 pid: 6529 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.202606:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658339.202832:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+25:3648:x1875544025137920:12345-0@lo:103:ldlm_bl.0 Request processed in 287us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658339.202841:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658339.202859:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658339.202865:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025138304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658339.202882:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658339.202888:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e80031800/0x48e67cc629c6e5f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e5f2 expref: 24 pid: 6530 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.202896:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e80031800/0x48e67cc629c6e5f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e5f2 expref: 24 pid: 6530 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.202907:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80031800/0x48e67cc629c6e5f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e5f2 expref: 24 pid: 6530 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.202917:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658339.202941:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:3648:x1875544025138304:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658339.202947:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658339.202959:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658339.202964:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:3650:x1875544025138176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658339.202970:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658339.202974:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d1200/0x48e67cc629c6e607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e600 expref: 22 pid: 6530 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.202981:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d1200/0x48e67cc629c6e607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e600 expref: 22 pid: 6530 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.202991:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d1200/0x48e67cc629c6e607 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e600 expref: 22 pid: 6530 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658339.203000:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658339.203027:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3650:x1875544025138176:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658339.203041:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658339.203090:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025138176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658339.205014:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658339.205191:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025138048 00000100:00100000:3.0:1788658339.205201:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025138048 00010000:00010000:3.0:1788658339.205241:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c6e65b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e654 expref: 21 pid: 6529 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658339.205284:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788658339.205294:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3649:x1875544025138048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658339.205309:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658339.205315:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c6e65b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e654 expref: 21 pid: 6529 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.205341:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c6e65b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e654 expref: 21 pid: 6529 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.205359:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d1e00/0x48e67cc629c6e65b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e654 expref: 21 pid: 6529 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.205376:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658339.205434:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84dbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:3649:x1875544025138048:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658339.205442:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788658339.205512:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025138048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658339.205989:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025138304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658339.206005:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025137920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658339.208393:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658339.208665:0:10411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10411:1875544025137280:192.168.202.53@tcp:104: 00010000:00010000:1.0:1788658339.208744:0:10411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658339.211355:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000960768 00000100:00100000:3.0:1788658339.211371:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000960768 00010000:00010000:3.0:1788658339.211419:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c6e899 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f8 expref: 10 pid: 6529 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658339.211552:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:3.0:1788658339.211563:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+10:2396:x1875544000960768:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658339.211579:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658339.211585:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c6e899 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f8 expref: 10 pid: 6529 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211599:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c6e899 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f8 expref: 10 pid: 6529 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211618:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390400/0x48e67cc629c6e899 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f8 expref: 10 pid: 6529 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211652:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211660:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211677:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211684:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211691:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211698:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211731:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658339.211735:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211743:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211754:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658339.211765:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658339.213125:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+9:2396:x1875544000960768:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 1557us (4740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658339.213217:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00010000:00010000:1.0:1788658339.213482:0:10411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.213494:0:10411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658339.213501:0:10411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b2c00/0x48e67cc629c6e95d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658339.264577:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658340.288881:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658340.803069:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658340.803140:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000960896 00000100:00100000:2.0:1788658340.803151:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000960896 00000100:00100000:2.0:1788658340.803210:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 248 00000100:00100000:2.0:1788658340.803223:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+9:6171:x1875544000960896:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658340.803239:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658340.803257:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6e964 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc63e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658340.803283:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6e964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc63e expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658340.803294:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6e964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc63e expref: 10 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658340.803303:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391a00, rc 0) 00000100:00100000:2.0:1788658340.803398:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:6171:x1875544000960896:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 178us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658340.803406:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 248 00000100:00100000:0.0:1788658340.809308:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658340.809399:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000961024 00000100:00100000:3.0:1788658340.809412:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000961024 00000100:00100000:3.0:1788658340.809467:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 249 00000100:00100000:3.0:1788658340.809477:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:6171:x1875544000961024:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658340.809650:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:6171:x1875544000961024:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 173us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658340.809659:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 249 00000100:00100000:0.0:1788658340.814958:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658340.815045:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000961152 00000100:00100000:3.0:1788658340.815054:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000961152 00000100:00100000:3.0:1788658340.818061:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 250 00000100:00100000:3.0:1788658340.818083:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e88550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:6171:x1875544000961152:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658340.818263:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e88550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:6171:x1875544000961152:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 188us (3313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658340.818271:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 250 00000100:00100000:0.0:1788658340.837581:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658340.838241:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000961280 00000100:00100000:2.0:1788658340.838254:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000961280 00000100:00100000:2.0:1788658340.838317:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 251 00000100:00100000:2.0:1788658340.838327:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:6710:x1875544000961280:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658340.838480:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:6710:x1875544000961280:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 153us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658340.838494:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 251 00000100:00100000:2.0:1788658340.843199:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658340.843286:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000961408 00000100:00100000:3.0:1788658340.843304:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000961408 00000100:00100000:3.0:1788658340.843385:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 252 00000100:00100000:3.0:1788658340.843399:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e915d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:6710:x1875544000961408:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788658340.843611:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e915d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:6710:x1875544000961408:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 215us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658340.843619:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 252 10000000:01000000:3.0:1788658341.054902:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788658341.054928:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d8230c000 from 4 10000000:01000000:3.0:1788658341.054933:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658341.054980:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658341.054993:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658341.055004:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658341.055032:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025138432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658341.055101:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658341.055177:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e831583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.055247:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025138432 00000100:00100000:2.0:1788658341.055255:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025138432 00000100:00100000:2.0:1788658341.055305:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788658341.055314:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025138432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658341.055331:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658341.055345:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6e972 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e96b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.055367:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6e972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e96b expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.055379:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6e972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e96b expref: 21 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.055388:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390a00, rc 0) 00000100:00100000:2.0:1788658341.055432:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025138432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.055440:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788658341.055495:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025138432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658341.055511:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658341.055522:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658341.055604:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025138560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658341.055632:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658341.055659:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e831583c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.057422:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025138560 00000100:00100000:2.0:1788658341.057433:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025138560 00000100:00100000:2.0:1788658341.057481:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788658341.057488:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025138560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.057617:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025138560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.057626:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788658341.057680:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025138560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.057748:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025138688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.057787:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.057807:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.057814:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025138688 00000100:00100000:2.0:1788658341.057817:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025138688 00000100:00100000:2.0:1788658341.057827:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788658341.057845:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025138688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.057929:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025138688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.057937:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788658341.057973:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025138688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.058148:0:10479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10479:1875544025138816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.058180:0:10479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.058386:0:10479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834c2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658341.063045:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025138816 00000100:00100000:3.0:1788658341.063061:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025138816 00000100:00100000:2.0:1788658341.063280:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788658341.063291:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:10479:x1875544025138816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.063482:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:10479:x1875544025138816:12345-0@lo:502:llog_process_th.0 Request processed in 191us (5300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.063491:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788658341.063524:0:10479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10479:1875544025138816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658341.063640:0:10479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658341.063652:0:10479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658341.063655:0:10479:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788658341.063665:0:10479:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1d8230c000 00000020:00000080:2.0:1788658341.063668:0:10479:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788658341.063798:0:10479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10479:1875544025138944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.063851:0:10479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.063875:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025138944 00000100:00100000:2.0:1788658341.063879:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025138944 00000100:00100000:2.0:1788658341.063896:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788658341.063901:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:10479:x1875544025138944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.063957:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:10479:x1875544025138944:12345-0@lo:502:llog_process_th.0 Request processed in 55us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.063964:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788658341.063998:0:10479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834c2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.064010:0:10479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10479:1875544025138944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658341.064027:0:10479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658341.064031:0:10479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658341.064033:0:10479:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788658341.064036:0:10479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788658341.064095:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788658341.064120:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658341.064130:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.064141:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658341.064151:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658341.064154:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ebd8b1800 from 4 10000000:01000000:2.0:1788658341.064157:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658341.064179:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.064197:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.064208:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658341.064221:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.064246:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.064259:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834c2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.064271:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025139072 00000100:00100000:2.0:1788658341.064275:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025139072 00000100:00100000:2.0:1788658341.064290:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788658341.064296:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025139072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658341.064304:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658341.064315:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e980 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e979 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.064335:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e979 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.064345:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e979 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.064354:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391400, rc 0) 00000100:00100000:2.0:1788658341.064380:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025139072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.064386:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788658341.064419:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658341.064431:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.064441:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658341.064488:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.064512:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.064525:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834c2480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.064536:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025139200 00000100:00100000:2.0:1788658341.064539:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025139200 00000100:00100000:2.0:1788658341.064555:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788658341.064561:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025139200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.064642:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025139200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.064648:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788658341.064673:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.064699:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.064755:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.064770:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e91ca0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.064781:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025139328 00000100:00100000:2.0:1788658341.064784:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025139328 00000100:00100000:2.0:1788658341.064800:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788658341.064805:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025139328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.064883:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025139328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.064895:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788658341.064930:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.065151:0:10480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10480:1875544025139456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.065184:0:10480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.065203:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025139456 00000100:00100000:2.0:1788658341.065206:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025139456 00000100:00100000:2.0:1788658341.065223:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788658341.065229:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:10480:x1875544025139456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.065302:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:10480:x1875544025139456:12345-0@lo:502:llog_process_th.0 Request processed in 73us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.065310:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788658341.065334:0:10480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e91ca0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.065346:0:10480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10480:1875544025139456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658341.065365:0:10480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658341.065372:0:10480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658341.065374:0:10480:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788658341.065381:0:10480:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1ebd8b1800 00000020:00000080:2.0:1788658341.065383:0:10480:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788658341.065434:0:10480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10480:1875544025139584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.065464:0:10480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.065482:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025139584 00000100:00100000:2.0:1788658341.065485:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025139584 00000100:00100000:2.0:1788658341.065501:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788658341.065506:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:10480:x1875544025139584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.065559:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:10480:x1875544025139584:12345-0@lo:502:llog_process_th.0 Request processed in 52us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.065571:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788658341.065612:0:10480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.065624:0:10480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10480:1875544025139584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658341.065640:0:10480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658341.065644:0:10480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658341.065646:0:10480:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788658341.065649:0:10480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788658341.065689:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788658341.065724:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658341.065732:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.065740:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658341.065749:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658341.065752:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ec11f4800 from 4 10000000:01000000:2.0:1788658341.065754:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658341.065773:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.065782:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.065791:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658341.065804:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.065829:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.065860:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.065871:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025139712 00000100:00100000:2.0:1788658341.065874:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025139712 00000100:00100000:2.0:1788658341.065888:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788658341.065893:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025139712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658341.065900:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658341.065909:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390e00/0x48e67cc629c6e98e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e987 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.065925:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390e00/0x48e67cc629c6e98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e987 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.065933:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390e00/0x48e67cc629c6e98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e987 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.065942:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390e00, rc 0) 00000100:00100000:2.0:1788658341.065966:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025139712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.065971:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788658341.065997:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658341.066006:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.066013:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658341.066050:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.066074:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.066092:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.066104:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025139840 00000100:00100000:2.0:1788658341.066107:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025139840 00000100:00100000:2.0:1788658341.066123:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788658341.066128:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025139840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.066197:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025139840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.066203:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788658341.066229:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.066253:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.066287:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.066299:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.066310:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025139968 00000100:00100000:2.0:1788658341.066313:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025139968 00000100:00100000:2.0:1788658341.066326:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788658341.066331:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025139968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.066395:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025139968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.066403:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788658341.066435:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025139968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.066624:0:10481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10481:1875544025140096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.066656:0:10481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.066674:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025140096 00000100:00100000:2.0:1788658341.066677:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025140096 00000100:00100000:2.0:1788658341.066693:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788658341.066699:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:10481:x1875544025140096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.066785:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:10481:x1875544025140096:12345-0@lo:502:llog_process_th.0 Request processed in 86us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.066793:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788658341.066818:0:10481:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.072338:0:10481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10481:1875544025140096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658341.072598:0:10481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658341.072609:0:10481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658341.072612:0:10481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788658341.072622:0:10481:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1ec11f4800 00000020:00000080:2.0:1788658341.072625:0:10481:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788658341.072741:0:10481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10481:1875544025140224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.072812:0:10481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.072862:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025140224 00000100:00100000:2.0:1788658341.072870:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025140224 00000100:00100000:2.0:1788658341.072915:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788658341.072924:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:10481:x1875544025140224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658341.073032:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:10481:x1875544025140224:12345-0@lo:502:llog_process_th.0 Request processed in 108us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658341.073039:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788658341.073082:0:10481:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658341.073100:0:10481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10481:1875544025140224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658341.073118:0:10481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658341.073122:0:10481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658341.073123:0:10481:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788658341.073127:0:10481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788658341.073186:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788658341.073210:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658341.073219:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.073229:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658341.073239:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658341.073242:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ec1212800 from 4 10000000:01000000:2.0:1788658341.073244:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658341.073269:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.073277:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658341.073286:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658341.073298:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025140352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658341.073323:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658341.073335:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658341.073813:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025140352 00000100:00100000:1.0:1788658341.073818:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025140352 00000100:00100000:1.0:1788658341.073860:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788658341.073868:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025140352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658341.073879:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658341.073891:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b2600/0x48e67cc629c6e99c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e995 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658341.073923:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b2600/0x48e67cc629c6e99c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e995 expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658341.073934:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b2600/0x48e67cc629c6e99c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e995 expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658341.073944:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2600, rc 0) 00000100:00100000:1.0:1788658341.073980:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025140352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658341.073987:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788658341.074012:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025140352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658341.074024:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658341.074032:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658341.074089:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025140480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658341.074113:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658341.074128:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82cf6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658341.074146:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025140480 00000100:00100000:1.0:1788658341.074151:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025140480 00000100:00100000:1.0:1788658341.074167:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788658341.074172:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025140480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658341.074262:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025140480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658341.074277:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788658341.074301:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025140480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658341.074327:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025140608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658341.074362:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658341.074370:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658341.074385:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025140608 00000100:00100000:1.0:1788658341.074388:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025140608 00000100:00100000:1.0:1788658341.074403:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788658341.074409:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025140608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658341.074477:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025140608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658341.074484:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788658341.074512:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025140608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658341.074685:0:10483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10483:1875544025140736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658341.074740:0:10483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658341.074755:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025140736 00000100:00100000:1.0:1788658341.074759:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025140736 00000100:00100000:1.0:1788658341.074774:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788658341.074779:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:10483:x1875544025140736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658341.074852:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:10483:x1875544025140736:12345-0@lo:502:llog_process_th.0 Request processed in 72us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658341.074858:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788658341.074888:0:10483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658341.074899:0:10483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10483:1875544025140736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658341.074927:0:10483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658341.074935:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658341.074937:0:10483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788658341.074943:0:10483:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1ec1212800 00000020:00000080:1.0:1788658341.074946:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788658341.075196:0:10483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10483:1875544025140864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658341.075228:0:10483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658341.075246:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025140864 00000100:00100000:1.0:1788658341.075250:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025140864 00000100:00100000:1.0:1788658341.075267:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788658341.075272:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:10483:x1875544025140864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658341.075325:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:10483:x1875544025140864:12345-0@lo:502:llog_process_th.0 Request processed in 52us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658341.075333:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788658341.075357:0:10483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658341.075368:0:10483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:10483:1875544025140864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658341.075386:0:10483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658341.075390:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658341.075392:0:10483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788658341.075395:0:10483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788658341.075440:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788658341.075457:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788658341.075467:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658341.075475:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658341.311057:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658341.311087:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025140992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658341.311201:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658341.311321:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025140992 00000100:00100000:0.0:1788658341.311330:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025140992 00000100:00100000:0.0:1788658341.311395:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788658341.311405:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025140992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658341.311443:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788658341.311496:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025140992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658341.311504:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788658341.311589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025140992:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788658341.311860:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658342.338409:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658342.848352:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025141120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658342.848436:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658342.848474:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025141120 00000100:00100000:3.0:1788658342.848483:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025141120 00000100:00100000:3.0:1788658342.848542:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658342.848553:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025141120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788658342.848585:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658342.848636:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025141120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658342.848643:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788658342.848822:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d81b39f80 x1875544025141120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658342.848842:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025141120:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788658342.850147:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658342.850202:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025141248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658342.850267:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658342.850322:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025141248 00000100:00100000:3.0:1788658342.850328:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025141248 00000100:00100000:3.0:1788658342.850388:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658342.850397:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025141248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788658342.850416:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658342.850459:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025141248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658342.850466:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788658342.850558:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788658342.850598:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2251880 x1875544025141248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658342.850813:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025141248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658342.853780:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025141504:0@lo:400:kworker.0 00000100:00100000:0.0:1788658342.853834:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025141632:0@lo:400:kworker.0 00000100:00100000:0.0:1788658342.853870:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658342.853877:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658342.853912:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025142144:0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.853919:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025142016:0@lo:400:kworker.0 00000100:00100000:0.0:1788658342.853935:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658342.853959:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025141504 00000100:00100000:0.0:1788658342.853959:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025142656:0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.853965:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025141504 00000100:00100000:0.0:1788658342.853981:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658342.853998:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788658342.854003:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025141760:0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.854004:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025142144 00000100:00100000:3.0:1788658342.854007:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025142144 00000100:00100000:0.0:1788658342.854023:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658342.854026:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025142656 00000100:00100000:3.0:1788658342.854028:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025142656 00000100:00100000:0.0:1788658342.854032:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025142272:0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.854040:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025141760 00000100:00100000:3.0:1788658342.854043:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025141760 00000100:00100000:0.0:1788658342.854055:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658342.854056:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788658342.854063:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025141504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658342.854083:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788658342.854090:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025142144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.854118:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025141504:12345-0@lo:400:kworker.0 Request processed in 55us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658342.854118:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025142144:12345-0@lo:400:kworker.0 Request processed in 29us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658342.854126:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788658342.854142:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788658342.854315:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025141376:0@lo:400:kworker.0 00000100:00100000:1.0:1788658342.854351:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658342.854377:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025141888:0@lo:400:kworker.0 00000100:00100000:1.0:1788658342.854401:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658342.854418:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025142400:0@lo:400:kworker.0 00000100:00100000:1.0:1788658342.854439:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658342.854468:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025141632 00000100:00100000:1.0:1788658342.854472:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025141632 00000100:00100000:1.0:1788658342.854497:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025141888 00000100:00100000:1.0:1788658342.854501:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025141888 00000100:00100000:1.0:1788658342.854515:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788658342.854522:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025141632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658342.854556:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025141632:12345-0@lo:400:kworker.0 Request processed in 34us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658342.854562:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788658342.854576:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788658342.854581:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025141888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658342.854625:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025141888:12345-0@lo:400:kworker.0 Request processed in 43us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658342.854638:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788658342.854656:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025141376 00000100:00100000:1.0:1788658342.854659:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025141376 00000100:00100000:1.0:1788658342.854680:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788658342.854686:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025141376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658342.854734:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025141376:12345-0@lo:400:kworker.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658342.854741:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788658342.854770:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025142272 00000100:00100000:1.0:1788658342.854774:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025142272 00000100:00100000:1.0:1788658342.854799:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025142400 00000100:00100000:1.0:1788658342.854802:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025142400 00000100:00100000:1.0:1788658342.854822:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788658342.854829:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025142272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658342.854858:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025142272:12345-0@lo:400:kworker.0 Request processed in 30us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658342.854865:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788658342.854876:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658342.854882:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025142400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658342.854921:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025142400:12345-0@lo:400:kworker.0 Request processed in 38us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658342.854927:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658342.854971:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025141376:0@lo:400:kworker.0 00000100:00100000:1.0:1788658342.854983:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025141888:0@lo:400:kworker.0 00010000:00080000:1.0:1788658342.854996:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebd9caa00 x1875544025142400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658342.855014:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025142400:0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.855291:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658342.855302:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025142656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.855336:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025142656:12345-0@lo:400:kworker.0 Request processed in 37us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658342.855343:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658342.855356:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788658342.855362:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025141760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.855388:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025141760:12345-0@lo:400:kworker.0 Request processed in 27us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658342.855394:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788658342.855413:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658342.855434:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025142528:0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.855457:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658342.855475:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025141504:0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.855496:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025142016 00000100:00100000:3.0:1788658342.855500:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025142016 00000100:00100000:3.0:1788658342.855518:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025142528 00000100:00100000:3.0:1788658342.855520:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025142528 00000100:00100000:3.0:1788658342.855533:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788658342.855538:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025142016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.855567:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025142016:12345-0@lo:400:kworker.0 Request processed in 29us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658342.855583:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788658342.855596:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788658342.855617:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025142528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.855647:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025142528:12345-0@lo:400:kworker.0 Request processed in 45us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658342.855653:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788658342.855677:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025142016:0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.855686:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025142528:0@lo:400:kworker.0 00000100:00080000:3.0:1788658342.855828:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658342.855833:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658342.855835:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658342.855861:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025141760:0@lo:400:kworker.0 00010000:00080000:3.0:1788658342.855874:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebd9c9880 x1875544025142272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658342.855884:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025142272:0@lo:400:kworker.0 00000100:00100000:3.0:1788658342.855907:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025141632:0@lo:400:kworker.0 00010000:00080000:3.0:1788658342.855918:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebd9cb480 x1875544025142144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658342.855926:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025142144:0@lo:400:kworker.0 00010000:00080000:3.0:1788658342.855935:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebd9c8000 x1875544025142656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658342.855942:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025142656:0@lo:400:kworker.0 00000100:00100000:0.0:1788658343.109401:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658343.109508:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658343.109548:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658343.109581:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658343.109622:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658343.109650:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000961792 00000100:00100000:0.0:1788658343.109659:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000961792 00000100:00100000:0.0:1788658343.109747:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000961664 00000100:00100000:0.0:1788658343.109751:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000961664 00000100:00100000:1.0:1788658343.109867:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000962048 00000100:00100000:1.0:1788658343.109872:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000962048 00000100:00100000:1.0:1788658343.109913:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000961920 00000100:00100000:1.0:1788658343.109916:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000961920 00000100:00100000:1.0:1788658343.109938:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:1.0:1788658343.109948:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000962048:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658343.110024:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000962048:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 78us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658343.110031:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:1.0:1788658343.110046:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:1.0:1788658343.110063:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000961920:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658343.110085:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000961920:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 33us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658343.110090:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:0.0:1788658343.110366:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:0.0:1788658343.110375:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000961792:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658343.110444:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000961792:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 70us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658343.110450:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:0.0:1788658343.110466:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 74 00000100:00100000:0.0:1788658343.110473:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000961664:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658343.110499:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000961664:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658343.110504:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 74 00000100:00080000:3.0:1788658343.110837:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658343.110842:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658343.110845:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658343.110847:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658343.113970:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000961536 00000100:00100000:2.0:1788658343.113988:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000961536 00000100:00100000:2.0:1788658343.114071:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 274 00000100:00100000:2.0:1788658343.114082:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544000961536:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658343.114159:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544000961536:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 78us (4769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658343.114167:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 274 00000100:00100000:3.0:1788658343.359093:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025142784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658343.359178:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658343.361197:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658343.361453:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025142912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658343.361513:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658343.367621:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025142784 00000100:00100000:2.0:1788658343.367644:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025142784 00000100:00100000:1.0:1788658343.367658:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025142912 00000100:00100000:1.0:1788658343.367673:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025142912 00000100:00100000:1.0:1788658343.367779:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658343.367966:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025142784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658343.368001:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658343.368085:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025142784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (8907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658343.368092:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658343.368113:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658343.368132:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025142912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658343.368145:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658343.368176:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025142912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (6662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658343.368182:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788658343.368285:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d81b3b100 x1875544025142912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658343.368318:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025142912:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788658343.368357:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f1f80 x1875544025142784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658343.368371:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025142784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658343.871309:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025143040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658343.871389:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658343.871654:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025143040 00000100:00100000:0.0:1788658343.871664:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025143040 00000100:00100000:0.0:1788658343.871734:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788658343.871744:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025143040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658343.871781:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788658343.879256:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025143040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7501us (7854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658343.879273:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788658343.883356:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025143040:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788658344.383018:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658345.412458:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658346.431794:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658346.431819:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025143168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658346.431903:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658346.431960:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025143168 00000100:00100000:2.0:1788658346.431969:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025143168 00000100:00100000:2.0:1788658346.432032:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788658346.432042:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025143168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658346.432076:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788658346.433673:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025143168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1624us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658346.433685:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788658346.433770:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025143168:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788658346.445723:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658346.557980:0:10711:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1788658347.458343:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658347.967021:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025143296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658347.967129:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658347.967214:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025143296 00000100:00100000:2.0:1788658347.967222:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025143296 00000100:00100000:2.0:1788658347.967281:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788658347.967305:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025143296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658347.967337:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658347.967388:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025143296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658347.967395:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788658347.967415:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788658347.967444:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d81b3b100 x1875544025143296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658347.967461:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025143296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658347.976141:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025143680:0@lo:400:kworker.0 00000100:00100000:1.0:1788658347.976221:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658347.976613:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025143808:0@lo:400:kworker.0 00000100:00100000:1.0:1788658347.976651:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658347.976748:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025144192:0@lo:400:kworker.0 00000100:00100000:1.0:1788658347.976773:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658347.976804:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025143808 00000100:00100000:1.0:1788658347.976812:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025143808 00000100:00100000:1.0:1788658347.976854:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025144192 00000100:00100000:1.0:1788658347.976858:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025144192 00000100:00100000:1.0:1788658347.976889:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788658347.976898:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025143808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658347.976945:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025143808:12345-0@lo:400:kworker.0 Request processed in 48us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658347.976965:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788658347.976982:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788658347.977465:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025144192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658347.977507:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025144192:12345-0@lo:400:kworker.0 Request processed in 520us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658347.977515:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788658347.977540:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788658347.977568:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bd500 x1875544025144192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658347.977581:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025144192:0@lo:400:kworker.0 00000100:00100000:1.0:1788658347.977610:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025143808:0@lo:400:kworker.0 00000100:00100000:1.0:1788658347.977646:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025144320:0@lo:400:kworker.0 00000100:00100000:2.0:1788658347.979283:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025143552:0@lo:400:kworker.0 00000100:00100000:2.0:1788658347.979356:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658347.979400:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025144064:0@lo:400:kworker.0 00000100:00100000:2.0:1788658347.979423:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658347.979454:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788658347.979461:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025143424:0@lo:400:kworker.0 00000100:00100000:2.0:1788658347.979488:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658347.979510:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025143936:0@lo:400:kworker.0 00000100:00100000:2.0:1788658347.979532:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658347.979548:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025144448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658347.979568:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658347.979598:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025143424 00000100:00100000:2.0:1788658347.979617:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025143424 00000100:00100000:2.0:1788658347.979659:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788658347.979667:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025143424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658347.979741:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025143424:12345-0@lo:400:kworker.0 Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658347.979749:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788658347.979784:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025143680 00000100:00100000:2.0:1788658347.979789:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025143680 00000100:00100000:2.0:1788658347.979809:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025143936 00000100:00100000:2.0:1788658347.979811:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025143936 00000100:00100000:2.0:1788658347.979821:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788658347.979826:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025143680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658347.979859:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025143680:12345-0@lo:400:kworker.0 Request processed in 32us (3638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658347.979864:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788658347.979874:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788658347.979880:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025143936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658347.979902:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025143552 00000100:00100000:2.0:1788658347.979905:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025143936:12345-0@lo:400:kworker.0 Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658347.979906:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025143552 00000100:00100000:2.0:1788658347.979910:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788658347.979932:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025144064 00000100:00100000:3.0:1788658347.979934:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025144064 00000100:00100000:2.0:1788658347.979944:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025143424:0@lo:400:kworker.0 00000100:00100000:2.0:1788658347.979954:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025143936:0@lo:400:kworker.0 00000100:00100000:3.0:1788658347.979956:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788658347.979962:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025143552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658347.980000:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025143552:12345-0@lo:400:kworker.0 Request processed in 39us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658347.980006:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788658347.980008:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025143552:0@lo:400:kworker.0 00000100:00100000:3.0:1788658347.980018:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788658347.980025:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025144064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658347.981170:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025143680:0@lo:400:kworker.0 00000100:00100000:0.0:1788658347.981231:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658347.981239:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025144576:0@lo:400:kworker.0 00000100:00100000:0.0:1788658347.981277:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658347.981839:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025144576 00000100:00100000:1.0:1788658347.981844:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025144576 00000100:00100000:1.0:1788658347.981887:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788658347.981896:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025144576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658347.983770:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025144064:12345-0@lo:400:kworker.0 Request processed in 3736us (4336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658347.983784:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788658347.983785:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025144704:0@lo:400:kworker.0 00000100:00080000:3.0:1788658347.983818:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658347.983824:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658347.983832:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658347.983837:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025144448 00000100:00100000:3.0:1788658347.983844:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025144448 00000100:00100000:0.0:1788658347.983858:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025144704 00000100:00100000:0.0:1788658347.983861:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025144704 00000100:00100000:3.0:1788658347.983882:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788658347.983883:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788658347.983888:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025144704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658347.983889:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025144448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788658347.983919:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658347.983928:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025144704:12345-0@lo:400:kworker.0 Request processed in 40us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658347.983944:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788658347.983953:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025144448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (4384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658347.983958:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788658347.983970:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658347.983973:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658347.983977:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025144704:0@lo:400:kworker.0 00010000:00080000:2.0:1788658347.984127:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e98369500 x1875544025144448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658347.984156:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025144448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658347.984173:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025144064:0@lo:400:kworker.0 00000100:00100000:1.0:1788658347.985173:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025144576:12345-0@lo:400:kworker.0 Request processed in 3275us (3891us total) trans 0 rc 0/0 00010000:00080000:2.0:1788658347.985187:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebd9c8000 x1875544025144576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658347.985195:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788658347.985197:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025144576:0@lo:400:kworker.0 00000100:00100000:1.0:1788658347.985239:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658347.985393:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025144832:0@lo:400:kworker.0 00000100:00100000:3.0:1788658347.985444:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658347.985477:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025144832 00000100:00100000:1.0:1788658347.985482:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025144832 00000100:00100000:1.0:1788658347.985534:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788658347.985543:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025144832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658347.985594:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025144832:12345-0@lo:400:kworker.0 Request processed in 53us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658347.985601:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788658347.985686:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025144320 00000100:00100000:2.0:1788658347.985691:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025144320 00000100:00100000:2.0:1788658347.985747:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788658347.985755:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025144320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658347.985793:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025144320:12345-0@lo:400:kworker.0 Request processed in 39us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658347.985799:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788658347.985858:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658347.985862:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788658347.985881:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bdc00 x1875544025144832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658347.985892:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025144832:0@lo:400:kworker.0 00010000:00080000:3.0:1788658347.985902:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bc000 x1875544025144320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658347.985910:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025144320:0@lo:400:kworker.0 00000100:00100000:0.0:1788658348.232657:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658348.232726:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658348.232759:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658348.232796:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658348.232819:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658348.232853:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000962688 00000100:00100000:0.0:1788658348.232863:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000962688 00000100:00100000:0.0:1788658348.232916:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000962560 00000100:00100000:0.0:1788658348.232920:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000962560 00000100:00100000:0.0:1788658348.232941:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:0.0:1788658348.232950:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000962688:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658348.233016:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000962688:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658348.233024:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:0.0:1788658348.233041:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:0.0:1788658348.233048:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000962560:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658348.233086:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000962560:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 39us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658348.233093:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:1.0:1788658348.233275:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000962176 00000100:00100000:1.0:1788658348.233279:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000962176 00000100:00100000:1.0:1788658348.233314:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 276 00000100:00100000:1.0:1788658348.233322:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:2396:x1875544000962176:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658348.233377:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:2396:x1875544000962176:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 55us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658348.233384:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 276 00000100:00100000:3.0:1788658348.233779:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000962432 00000100:00100000:3.0:1788658348.233783:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000962432 00000100:00100000:3.0:1788658348.233817:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000962304 00000100:00100000:3.0:1788658348.233820:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000962304 00000100:00100000:3.0:1788658348.233850:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:3.0:1788658348.233858:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000962432:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658348.233901:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000962432:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 44us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658348.233908:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:3.0:1788658348.233935:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 82 00000100:00100000:3.0:1788658348.233940:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544000962304:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658348.233964:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544000962304:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658348.233970:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 82 00000100:00080000:3.0:1788658348.233984:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658348.233988:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658348.233990:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658348.233992:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658348.479644:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658348.479678:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025144960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658348.480013:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658348.480246:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025144960 00000100:00100000:2.0:1788658348.480257:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025144960 00000100:00100000:2.0:1788658348.480326:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658348.480337:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025144960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788658348.480374:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658348.480446:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025144960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658348.480454:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788658348.480534:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f0a80 x1875544025144960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658348.480552:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025144960:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788658348.481038:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658348.481183:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025145088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658348.481248:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658348.481394:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025145088 00000100:00100000:2.0:1788658348.481401:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025145088 00000100:00100000:2.0:1788658348.481448:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658348.481457:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025145088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658348.481485:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658348.481860:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025145088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 402us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658348.481869:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788658348.481948:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebd9c9500 x1875544025145088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658348.482041:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025145088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658348.995019:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658348.995051:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025145216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658348.995157:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658348.995239:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025145216 00000100:00100000:2.0:1788658348.995250:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025145216 00000100:00100000:2.0:1788658348.995309:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788658348.995321:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025145216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658348.995368:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788658348.995436:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025145216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658348.995443:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788658348.995503:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025145216:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788658349.502893:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658350.527967:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658351.551201:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658351.551422:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658351.551448:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025145344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658351.551523:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658351.551666:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025145344 00000100:00100000:0.0:1788658351.551674:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025145344 00000100:00100000:0.0:1788658351.551758:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788658351.551767:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025145344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658351.551801:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788658351.552988:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025145344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1215us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658351.552999:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788658351.553225:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025145344:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1788658351.902231:0:10954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing yml_node 00010000:00010000:0.0:1788658352.574918:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658353.086942:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025145472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658353.087015:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658353.087092:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025145472 00000100:00100000:2.0:1788658353.087100:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025145472 00000100:00100000:2.0:1788658353.087151:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658353.087161:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025145472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658353.087192:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658353.087249:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025145472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658353.087257:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788658353.087286:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788658353.087319:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f2d80 x1875544025145472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658353.087337:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025145472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658353.087613:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025145600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658353.087647:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.087675:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025145600 00000100:00100000:0.0:1788658353.087680:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025145600 00000100:00100000:0.0:1788658353.087724:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788658353.087731:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025145600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658353.087743:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658353.087774:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025145600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.087781:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788658353.087809:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebd9c9500 x1875544025145600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658353.087823:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025145600:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788658353.087836:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658353.088842:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025145728:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.088898:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.088932:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025146240:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.088955:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.088977:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025146752:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.089013:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.089036:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788658353.089041:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025145856:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.089066:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.089083:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025146368:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.089100:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.089114:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025146880:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.089132:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.089346:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025146752 00000100:00100000:0.0:1788658353.089352:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025146752 00000100:00100000:1.0:1788658353.089494:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025146240 00000100:00100000:1.0:1788658353.089499:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025146240 00000100:00100000:1.0:1788658353.089534:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788658353.089542:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025146240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658353.089598:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025146240:12345-0@lo:400:kworker.0 Request processed in 58us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658353.089605:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788658353.089672:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788658353.089679:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025146752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.089736:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025146752:12345-0@lo:400:kworker.0 Request processed in 58us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.089742:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788658353.089760:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025145856 00000100:00100000:0.0:1788658353.089763:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025145856 00000100:00100000:0.0:1788658353.089784:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025146368 00000100:00100000:0.0:1788658353.089788:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025146368 00000100:00100000:0.0:1788658353.089802:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025146880 00000100:00100000:0.0:1788658353.089804:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025146880 00000100:00100000:0.0:1788658353.089817:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788658353.089822:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025145856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.089864:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025145856:12345-0@lo:400:kworker.0 Request processed in 41us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.089871:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788658353.089883:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788658353.089889:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025146368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.089918:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025146368:12345-0@lo:400:kworker.0 Request processed in 30us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.089923:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788658353.089933:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788658353.089939:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025146880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.089962:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025146880:12345-0@lo:400:kworker.0 Request processed in 23us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.089968:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788658353.090008:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025145856:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.090019:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025146368:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.090027:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025146880:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.090035:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025146240:0@lo:400:kworker.0 00010000:00080000:0.0:1788658353.090045:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8379ad80 x1875544025146752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658353.090055:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025146752:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.090090:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025146112:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.090116:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.090142:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025146624:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.090166:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.090188:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788658353.090194:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025145984:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.090232:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.090251:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025146496:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.090271:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.090286:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025147008:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.090304:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.090324:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025146112 00000100:00100000:0.0:1788658353.090328:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025146112 00000100:00100000:0.0:1788658353.090347:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025146496 00000100:00100000:0.0:1788658353.090350:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025146496 00000100:00100000:0.0:1788658353.090364:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025147008 00000100:00100000:0.0:1788658353.090366:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025147008 00000100:00100000:0.0:1788658353.090378:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788658353.090608:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025145728 00000100:00100000:3.0:1788658353.090613:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025145728 00000100:00100000:3.0:1788658353.090749:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788658353.090756:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025145728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658353.090798:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025145728:12345-0@lo:400:kworker.0 Request processed in 43us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658353.090803:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788658353.090884:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025146624 00000100:00100000:1.0:1788658353.090888:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025146624 00000100:00100000:1.0:1788658353.090925:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788658353.090933:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdc24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025146624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658353.090981:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdc24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025146624:12345-0@lo:400:kworker.0 Request processed in 50us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658353.090988:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788658353.091251:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025146112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.091286:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025146112:12345-0@lo:400:kworker.0 Request processed in 903us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.091294:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788658353.091310:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788658353.091317:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025146496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.091344:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025146496:12345-0@lo:400:kworker.0 Request processed in 28us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.091350:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788658353.091361:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788658353.091366:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025147008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.091476:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025147008:12345-0@lo:400:kworker.0 Request processed in 110us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.091483:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788658353.091504:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025145984 00000100:00100000:0.0:1788658353.091508:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025145984 00000100:00100000:0.0:1788658353.091574:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788658353.091581:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025145984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.091614:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025145984:12345-0@lo:400:kworker.0 Request processed in 33us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.091620:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788658353.096002:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658353.096011:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658353.096015:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658353.096231:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025145728:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.096529:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025145984:0@lo:400:kworker.0 00010000:00080000:0.0:1788658353.096549:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8379b100 x1875544025146496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658353.096560:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025146496:0@lo:400:kworker.0 00010000:00080000:0.0:1788658353.096573:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83798380 x1875544025147008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658353.096582:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025147008:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.096595:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025146112:0@lo:400:kworker.0 00010000:00080000:0.0:1788658353.096607:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83799f80 x1875544025146624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658353.096615:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025146624:0@lo:400:kworker.0 00000100:00100000:0.0:1788658353.350367:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658353.350423:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658353.350474:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658353.350503:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658353.350531:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658353.350565:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000963072 00000100:00100000:0.0:1788658353.350574:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000963072 00000100:00100000:0.0:1788658353.350638:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000962944 00000100:00100000:0.0:1788658353.350641:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000962944 00000100:00100000:0.0:1788658353.350668:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:0.0:1788658353.350679:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000963072:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658353.350782:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000963072:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 105us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.350791:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:0.0:1788658353.350811:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:0.0:1788658353.350817:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000962944:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658353.350842:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000962944:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.350849:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:0.0:1788658353.350880:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000963200 00000100:00100000:0.0:1788658353.350884:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000963200 00000100:00100000:0.0:1788658353.350922:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000963328 00000100:00100000:0.0:1788658353.350934:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000963328 00000100:00100000:2.0:1788658353.351224:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000962816 00000100:00100000:2.0:1788658353.351229:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000962816 00000100:00100000:2.0:1788658353.351259:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 278 00000100:00100000:2.0:1788658353.351265:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544000962816:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658353.351291:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544000962816:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658353.351298:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 278 00000100:00100000:0.0:1788658353.351953:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1788658353.352483:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2395:x1875544000963200:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:0.0:1788658353.352522:0:8454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e8ae 00000100:00080000:0.0:1788658353.352534:0:8454:0:(import.c:65:import_set_state_nolock()) ffff8a1d81abe800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658353.353807:0:8454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788658353.353968:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+2:2395:x1875544000963200:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 1497us (3459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.353990:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1788658353.354015:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:0.0:1788658353.354025:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2395:x1875544000963328:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:0.0:1788658353.354048:0:8454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e8b5 00000100:00080000:0.0:1788658353.354056:0:8454:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc0d000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788658353.354152:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658353.354158:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788658353.354161:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658353.354163:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788658353.359503:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788658353.366106:0:8454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788658353.366323:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+2:2395:x1875544000963328:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 12292us (15783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.366337:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00010000:00010000:2.0:1788658353.366488:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658353.598995:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658353.599245:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025147136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658353.599328:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658353.599564:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025147136 00000100:00100000:0.0:1788658353.599574:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025147136 00000100:00100000:0.0:1788658353.599632:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788658353.599642:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025147136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658353.599676:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658353.599745:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025147136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658353.599752:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1788658353.600105:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8374c000 x1875544025147136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658353.600125:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025147136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658353.600522:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658353.600535:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025147264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658353.600572:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658353.600738:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025147264 00000100:00100000:2.0:1788658353.600744:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025147264 00000100:00100000:2.0:1788658353.600780:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788658353.600789:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025147264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788658353.600805:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658353.600849:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025147264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658353.600856:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788658353.600930:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f2d80 x1875544025147264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658353.600943:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025147264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658354.110971:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658354.113282:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025147392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658354.113373:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658354.116403:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025147392 00000100:00100000:2.0:1788658354.116418:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025147392 00000100:00100000:2.0:1788658354.116565:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788658354.116577:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025147392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658354.116636:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788658354.116753:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025147392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 178us (3380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658354.116762:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788658354.116856:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025147392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788658354.623012:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658355.651255:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658356.129506:0:11138:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000100:00100000:3.0:1788658356.671335:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025147520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658356.671414:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658356.671583:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025147520 00000100:00100000:0.0:1788658356.671592:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025147520 00000100:00100000:0.0:1788658356.671660:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788658356.671671:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025147520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658356.671872:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788658356.671924:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025147520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 255us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658356.671932:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788658356.672049:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025147520:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788658356.672117:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658357.694914:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658358.206980:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025148032:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207049:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207098:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025148544:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207126:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207144:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025149056:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207166:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207197:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788658358.207204:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025147648:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207231:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207261:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025148160:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207308:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207330:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025148672:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207354:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207392:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025149184:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207413:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207440:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025147776:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207463:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207483:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025148288:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207502:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207516:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025148800:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207534:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207550:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788658358.207564:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025147904:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207587:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207602:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025148416:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207624:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207633:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025148928:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207651:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658358.207677:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025148032 00000100:00100000:3.0:1788658358.207684:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025148032 00000100:00100000:3.0:1788658358.207750:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025147776 00000100:00100000:3.0:1788658358.207753:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025147776 00000100:00100000:3.0:1788658358.207766:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025148288 00000100:00100000:3.0:1788658358.207769:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025148288 00000100:00100000:3.0:1788658358.207788:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025148800 00000100:00100000:3.0:1788658358.207791:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025148800 00000100:00100000:3.0:1788658358.207805:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025148416 00000100:00100000:3.0:1788658358.207808:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025148416 00000100:00100000:3.0:1788658358.207821:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025148928 00000100:00100000:3.0:1788658358.207822:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025148928 00000100:00100000:3.0:1788658358.207833:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788658358.207838:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025148032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207879:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025148032:12345-0@lo:400:kworker.0 Request processed in 41us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.207883:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788658358.207897:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788658358.207900:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025147776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207917:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025147776:12345-0@lo:400:kworker.0 Request processed in 17us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.207921:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788658358.207935:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788658358.207939:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025148288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207957:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025148288:12345-0@lo:400:kworker.0 Request processed in 19us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.207961:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788658358.207967:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788658358.207970:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025148800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.207983:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025148800:12345-0@lo:400:kworker.0 Request processed in 13us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.207987:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788658358.207993:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788658358.207996:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025148416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208009:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025148416:12345-0@lo:400:kworker.0 Request processed in 13us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.208013:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788658358.208018:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788658358.208021:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025148928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208034:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025148928:12345-0@lo:400:kworker.0 Request processed in 12us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.208037:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788658358.208048:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025148544 00000100:00100000:3.0:1788658358.208050:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025148544 00000100:00100000:3.0:1788658358.208062:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025149056 00000100:00100000:3.0:1788658358.208064:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025149056 00000100:00100000:3.0:1788658358.208071:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025148672 00000100:00100000:3.0:1788658358.208073:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025148672 00000100:00100000:3.0:1788658358.208079:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025149184 00000100:00100000:3.0:1788658358.208085:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025149184 00000100:00100000:3.0:1788658358.208096:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788658358.208099:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025148544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208119:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025148544:12345-0@lo:400:kworker.0 Request processed in 20us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.208123:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788658358.208130:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788658358.208133:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025149056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208147:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025149056:12345-0@lo:400:kworker.0 Request processed in 14us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.208150:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788658358.208155:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788658358.208159:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025148672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208172:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025148672:12345-0@lo:400:kworker.0 Request processed in 13us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.208175:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788658358.208180:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788658358.208183:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025149184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208196:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025149184:12345-0@lo:400:kworker.0 Request processed in 12us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.208199:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788658358.208213:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025147648 00000100:00100000:3.0:1788658358.208215:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025147648 00000100:00100000:3.0:1788658358.208229:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788658358.208236:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025147648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208263:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025147648:12345-0@lo:400:kworker.0 Request processed in 27us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.208275:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788658358.208305:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025148160 00000100:00100000:3.0:1788658358.208309:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025148160 00000100:00100000:3.0:1788658358.208330:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025147904 00000100:00100000:3.0:1788658358.208333:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025147904 00000100:00100000:3.0:1788658358.208344:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788658358.208350:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025148160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208399:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025148160:12345-0@lo:400:kworker.0 Request processed in 48us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.208405:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788658358.208414:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788658358.208418:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025147904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208437:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025147904:12345-0@lo:400:kworker.0 Request processed in 20us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.208442:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788658358.208471:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025147904:0@lo:400:kworker.0 00010000:00080000:3.0:1788658358.208481:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83799180 x1875544025148416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658358.208488:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025148416:0@lo:400:kworker.0 00010000:00080000:3.0:1788658358.208493:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8379b480 x1875544025148928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658358.208499:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025148928:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208505:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025147776:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208510:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025148288:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208523:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025148800:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208546:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025147648:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208552:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025148160:0@lo:400:kworker.0 00010000:00080000:3.0:1788658358.208558:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8379b100 x1875544025148672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658358.208563:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025148672:0@lo:400:kworker.0 00010000:00080000:3.0:1788658358.208569:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83798000 x1875544025149184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658358.208574:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025149184:0@lo:400:kworker.0 00000100:00100000:3.0:1788658358.208580:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025148032:0@lo:400:kworker.0 00010000:00080000:3.0:1788658358.208584:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83798380 x1875544025148544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658358.208589:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025148544:0@lo:400:kworker.0 00010000:00080000:3.0:1788658358.208594:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8379ad80 x1875544025149056/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658358.208599:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025149056:0@lo:400:kworker.0 00000100:00100000:0.0:1788658358.209056:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658358.209065:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025149312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658358.209091:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658358.209195:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025149312 00000100:00100000:2.0:1788658358.209199:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025149312 00000100:00100000:2.0:1788658358.209221:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788658358.209226:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025149312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658358.209249:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658358.209290:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025149312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658358.209297:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788658358.209454:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8374e300 x1875544025149312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658358.209465:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025149312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658358.209656:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658358.209663:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025149440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658358.209683:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658358.209898:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025149440 00000100:00100000:2.0:1788658358.209903:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025149440 00000100:00100000:2.0:1788658358.209940:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658358.209947:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025149440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658358.209959:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658358.209992:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025149440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658358.209997:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788658358.210041:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8374df80 x1875544025149440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658358.210050:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025149440:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788658358.211163:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658358.211170:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788658358.211173:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658358.211176:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658358.457880:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658358.457923:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658358.457951:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658358.457977:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000963712 00000100:00100000:3.0:1788658358.457986:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000963712 00000100:00100000:3.0:1788658358.458055:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000963584 00000100:00100000:3.0:1788658358.458060:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000963584 00000100:00100000:3.0:1788658358.458086:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:3.0:1788658358.458095:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000963712:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658358.458168:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000963712:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 74us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.458176:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:3.0:1788658358.458193:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:3.0:1788658358.458200:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544000963584:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658358.458224:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544000963584:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658358.458248:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00080000:3.0:1788658358.458279:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658358.458284:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658358.458488:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000963456 00000100:00100000:2.0:1788658358.458507:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000963456 00000100:00100000:2.0:1788658358.458537:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 280 00000100:00100000:2.0:1788658358.458544:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:2398:x1875544000963456:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658358.458579:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:2398:x1875544000963456:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 35us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658358.458586:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 280 00000001:02000400:0.0:1788658358.599223:0:11235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:1.0:1788658358.720639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025149568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658358.720742:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658358.720812:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025149568 00000100:00100000:1.0:1788658358.720820:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025149568 00000100:00100000:1.0:1788658358.720860:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788658358.720868:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025149568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658358.720898:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658358.720936:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025149568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658358.720943:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788658358.720983:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bd500 x1875544025149568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658358.721001:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025149568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788658358.724839:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658358.727774:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025149696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658358.727853:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1788658358.728104:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:0.0:1788658358.728110:0:8447:0:(genops.c:885:class_export_put()) final put ffff8a1d81ab9000/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:3.0:1788658358.728634:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d81ab9000/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 for lustre-OST0000 00000020:00000080:3.0:1788658358.728720:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d81abe800 for lustre-OST0000 00000100:00100000:1.0:1788658358.731789:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025149696 00000100:00100000:1.0:1788658358.731803:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025149696 00000100:00100000:1.0:1788658358.731858:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658358.731869:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025149696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658358.731897:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658358.731978:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025149696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (4124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658358.731996:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000001:00100000:2.0:1788658358.734818:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:2.0:1788658358.734829:0:9530:0:(genops.c:885:class_export_put()) final put ffff8a1ebdc09800/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:2.0:1788658358.734854:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdc09800/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 for lustre-OST0001 00000020:00000080:2.0:1788658358.735270:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ebdc0d000 for lustre-OST0001 00010000:00080000:2.0:1788658358.736010:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8374df80 x1875544025149696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658358.736036:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025149696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658359.242809:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658359.242831:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025149824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658359.242902:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658359.242960:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025149824 00000100:00100000:0.0:1788658359.242968:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025149824 00000100:00100000:0.0:1788658359.243009:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788658359.243017:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025149824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658359.243062:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788658359.243257:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025149824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658359.243330:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788658359.243381:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025149824:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658359.762128:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658360.771186:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658361.236203:0:11333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:1.0:1788658361.791734:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658361.791761:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025149952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658361.791834:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658361.791885:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658361.791948:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025149952 00000100:00100000:0.0:1788658361.791956:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025149952 00000100:00100000:0.0:1788658361.792017:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788658361.792026:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025149952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658361.792060:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788658361.792113:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025149952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658361.792121:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788658361.792211:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025149952:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1788658362.812210:0:11381:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 21:32:41 EDT 2026 00010000:00010000:2.0:1788658362.819108:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658363.327663:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658363.327692:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025150080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658363.327816:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658363.328281:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025150080 00000100:00100000:1.0:1788658363.328303:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025150080 00000100:00100000:1.0:1788658363.328374:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788658363.328386:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025150080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658363.328418:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658363.328464:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025150080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658363.328471:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788658363.328660:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658363.333380:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025150208:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658363.333464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788658363.333561:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8374e300 x1875544025150080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658363.333584:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025150080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658363.334742:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025150720:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.334799:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.334839:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025151232:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.334862:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.334893:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788658363.334899:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025150592:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.334920:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.334937:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025151104:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.334956:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.334968:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025151616:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.334985:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.335022:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025150464:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335043:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.335056:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025150976:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335073:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.335081:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025151488:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335101:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.335111:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788658363.335116:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025150336:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335138:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.335160:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025150848:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335179:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.335191:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025151360:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335210:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658363.335247:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025150336 00000100:00100000:2.0:1788658363.335254:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025150336 00000100:00100000:2.0:1788658363.335295:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788658363.335311:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025150336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335355:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025150336:12345-0@lo:400:kworker.0 Request processed in 46us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658363.335362:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788658363.335403:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025150336:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335431:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025150592 00000100:00100000:2.0:1788658363.335434:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025150592 00000100:00100000:2.0:1788658363.335454:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025150848 00000100:00100000:2.0:1788658363.335457:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025150848 00000100:00100000:2.0:1788658363.335467:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788658363.335472:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025150592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335505:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025150592:12345-0@lo:400:kworker.0 Request processed in 32us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658363.335510:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788658363.335536:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788658363.335542:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025150848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335572:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025150848:12345-0@lo:400:kworker.0 Request processed in 31us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658363.335577:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788658363.335600:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025150848:0@lo:400:kworker.0 00000100:00100000:2.0:1788658363.335621:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025150592:0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336125:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025150720 00000100:00100000:3.0:1788658363.336130:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025150720 00000100:00100000:3.0:1788658363.336154:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025151104 00000100:00100000:3.0:1788658363.336156:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025151104 00000100:00100000:3.0:1788658363.336199:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025151616 00000100:00100000:3.0:1788658363.336202:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025151616 00000100:00100000:3.0:1788658363.336213:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025150464 00000100:00100000:3.0:1788658363.336226:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025150464 00000100:00100000:3.0:1788658363.336239:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025150976 00000100:00100000:3.0:1788658363.336241:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025150976 00000100:00100000:3.0:1788658363.336252:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025151488 00000100:00100000:3.0:1788658363.336255:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025151488 00000100:00100000:3.0:1788658363.336270:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788658363.336276:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025150720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336327:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025150720:12345-0@lo:400:kworker.0 Request processed in 51us (1529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658363.336335:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788658363.336350:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788658363.336358:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025151104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336387:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025151104:12345-0@lo:400:kworker.0 Request processed in 31us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658363.336393:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788658363.336404:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788658363.336410:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025151616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336438:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025151616:12345-0@lo:400:kworker.0 Request processed in 29us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658363.336444:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788658363.336455:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788658363.336460:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025150464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336492:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025150464:12345-0@lo:400:kworker.0 Request processed in 33us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658363.336508:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788658363.336534:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788658363.336540:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025150976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336570:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025150976:12345-0@lo:400:kworker.0 Request processed in 30us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658363.336576:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788658363.336586:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788658363.336591:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025151488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336620:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025151488:12345-0@lo:400:kworker.0 Request processed in 29us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658363.336625:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788658363.336644:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025151232 00000100:00100000:3.0:1788658363.336648:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025151232 00000100:00100000:3.0:1788658363.336674:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025151360 00000100:00100000:3.0:1788658363.336677:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025151360 00000100:00100000:3.0:1788658363.336695:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788658363.336732:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025151232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336775:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025151232:12345-0@lo:400:kworker.0 Request processed in 63us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658363.336782:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788658363.336793:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788658363.336810:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025151360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336838:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025151360:12345-0@lo:400:kworker.0 Request processed in 39us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658363.336844:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788658363.336919:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb39500 x1875544025151360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658363.336933:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025151360:0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336947:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025150464:0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336957:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025150976:0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.336967:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025151488:0@lo:400:kworker.0 00010000:00080000:3.0:1788658363.337011:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3a680 x1875544025151104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658363.337021:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025151104:0@lo:400:kworker.0 00010000:00080000:3.0:1788658363.337032:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3b480 x1875544025151616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658363.337039:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025151616:0@lo:400:kworker.0 00000100:00100000:3.0:1788658363.337050:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025150720:0@lo:400:kworker.0 00010000:00080000:3.0:1788658363.337059:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3bb80 x1875544025151232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658363.337066:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025151232:0@lo:400:kworker.0 00000100:00100000:1.0:1788658363.339721:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025150208 00000100:00100000:1.0:1788658363.339735:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025150208 00000100:00100000:1.0:1788658363.339802:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788658363.339812:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025150208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658363.339836:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658363.339936:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025150208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 126us (6472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658363.339943:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788658363.339987:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8374c000 x1875544025150208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658363.340007:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025150208:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788658363.345643:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658363.345655:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658363.345659:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658363.345662:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658363.579930:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658363.580058:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000963840 00000100:00100000:1.0:1788658363.580067:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000963840 00000100:00100000:1.0:1788658363.580123:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 282 00000100:00100000:1.0:1788658363.580132:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:2396:x1875544000963840:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658363.580197:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:2396:x1875544000963840:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 67us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658363.580205:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 282 00000100:00100000:3.0:1788658363.581018:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658363.581054:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658363.581080:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000964096 00000100:00100000:3.0:1788658363.581086:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000964096 00000100:00100000:3.0:1788658363.581127:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000963968 00000100:00100000:3.0:1788658363.581140:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000963968 00000100:00100000:3.0:1788658363.581167:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 105 00000100:00100000:3.0:1788658363.581174:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000964096:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658363.581218:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000964096:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 45us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658363.581225:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 105 00000100:00100000:3.0:1788658363.581241:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 106 00000100:00100000:3.0:1788658363.581246:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544000963968:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658363.581269:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544000963968:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658363.581275:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 106 00000100:00080000:3.0:1788658363.582013:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658363.582019:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788658363.841264:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658363.841781:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658363.841811:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025151744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658363.841882:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658363.841894:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025151872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658363.841926:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658363.841952:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025151744 00000100:00100000:1.0:1788658363.841959:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025151744 00000100:00100000:1.0:1788658363.841997:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025151872 00000100:00100000:1.0:1788658363.842000:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025151872 00000100:00100000:1.0:1788658363.842018:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788658363.842026:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025151744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658363.842058:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658363.842112:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025151744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658363.842120:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788658363.842138:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658363.842144:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025151872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658363.842156:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788658363.842198:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bea00 x1875544025151744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658363.842218:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025151744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658363.844130:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025151872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1978us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658363.844143:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788658363.845872:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83433b80 x1875544025151872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658363.846389:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025151872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658364.361060:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025152000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658364.361288:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658364.361378:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025152000 00000100:00100000:3.0:1788658364.361386:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025152000 00000100:00100000:3.0:1788658364.361436:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788658364.361456:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025152000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658364.361493:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788658364.361559:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025152000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658364.361566:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788658364.361615:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025152000:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658364.863010:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658365.887262:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658366.911862:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025152128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658366.911935:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658366.912030:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025152128 00000100:00100000:3.0:1788658366.912038:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025152128 00000100:00100000:3.0:1788658366.912193:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788658366.912202:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025152128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658366.912238:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658366.912329:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025152128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658366.912337:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788658366.912384:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025152128:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788658366.912954:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658367.936507:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658368.448024:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025152256:0@lo:400:kworker.0 00000100:00100000:0.0:1788658368.448025:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025152384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658368.449013:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.449081:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025152896:0@lo:400:kworker.0 00000100:00100000:0.0:1788658368.449122:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.449161:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025153408:0@lo:400:kworker.0 00000100:00100000:0.0:1788658368.449202:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.449222:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025153920:0@lo:400:kworker.0 00000100:00100000:0.0:1788658368.449244:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.449270:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788658368.449277:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025152512:0@lo:400:kworker.0 00000100:00100000:0.0:1788658368.449301:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.449319:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025153024:0@lo:400:kworker.0 00000100:00100000:0.0:1788658368.449338:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.449354:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025153536:0@lo:400:kworker.0 00000100:00100000:0.0:1788658368.449373:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.449402:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025154048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658368.449422:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.449459:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025152384 00000100:00100000:0.0:1788658368.449468:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025152384 00000100:00100000:2.0:1788658368.450148:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025154048 00000100:00100000:2.0:1788658368.450155:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025154048 00000100:00100000:0.0:1788658368.450262:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658368.450450:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025152640:0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.450497:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.450514:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025152384:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658368.450536:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025153152:0@lo:400:kworker.0 00002000:00000024:0.0:1788658368.450551:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658368.450565:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658368.450607:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025152896 00000100:00100000:2.0:1788658368.450612:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025152896 00000100:00100000:2.0:1788658368.450652:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025152640 00000100:00100000:2.0:1788658368.450655:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025152640 00000100:00100000:2.0:1788658368.450669:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788658368.450687:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025152896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658368.450760:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025152896:12345-0@lo:400:kworker.0 Request processed in 84us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658368.450768:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788658368.450785:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788658368.450791:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025152640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658368.450836:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025152640:12345-0@lo:400:kworker.0 Request processed in 45us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658368.450843:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788658368.450880:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025152896:0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.451079:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025153664:0@lo:400:kworker.0 00000100:00100000:2.0:1788658368.451098:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025152512 00000100:00100000:2.0:1788658368.451104:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025152512 00000100:00100000:3.0:1788658368.451109:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658368.451133:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025152640:0@lo:400:kworker.0 00000100:00100000:2.0:1788658368.451144:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025153024 00000100:00100000:2.0:1788658368.451148:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025153024 00000100:00100000:2.0:1788658368.451164:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025153536 00000100:00100000:2.0:1788658368.451167:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025153536 00000100:00100000:3.0:1788658368.451177:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025153408 00000100:00100000:2.0:1788658368.451194:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025153152 00000100:00100000:3.0:1788658368.451195:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025153408 00000100:00100000:2.0:1788658368.451201:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025153152 00000100:00100000:2.0:1788658368.451225:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025153664 00000100:00100000:2.0:1788658368.451228:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025153664 00000100:00100000:3.0:1788658368.451234:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025153920 00000100:00100000:3.0:1788658368.451239:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025153920 00000100:00100000:2.0:1788658368.451250:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788658368.451260:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025152512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.451267:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788658368.451276:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025153408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658368.451327:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025152512:12345-0@lo:400:kworker.0 Request processed in 68us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.451329:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025153408:12345-0@lo:400:kworker.0 Request processed in 54us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658368.451343:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788658368.451344:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658368.451366:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788658368.451368:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788658368.451378:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025153024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.451380:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025153920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.451410:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025153920:12345-0@lo:400:kworker.0 Request processed in 34us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.451415:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788658368.451439:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788658368.451445:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025153536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.451474:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025153536:12345-0@lo:400:kworker.0 Request processed in 30us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.451480:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788658368.451491:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788658368.451496:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025153152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.451528:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025153152:12345-0@lo:400:kworker.0 Request processed in 32us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.451534:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788658368.451543:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788658368.451549:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025153664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658368.451868:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025153024:12345-0@lo:400:kworker.0 Request processed in 493us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658368.451876:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788658368.451908:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025152512:0@lo:400:kworker.0 00000100:00100000:2.0:1788658368.451923:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025153024:0@lo:400:kworker.0 00000100:00100000:2.0:1788658368.451934:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025153536:0@lo:400:kworker.0 00010000:00080000:2.0:1788658368.451949:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c0000 x1875544025153408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658368.451961:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025153408:0@lo:400:kworker.0 00010000:00080000:2.0:1788658368.451973:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef4700 x1875544025153920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658368.451982:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025153920:0@lo:400:kworker.0 00000100:00100000:0.0:1788658368.452373:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025152384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2101us (3362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658368.452383:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788658368.452416:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788658368.452425:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025154048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658368.452441:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658368.452474:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025154048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658368.452491:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788658368.453073:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb39880 x1875544025152384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658368.453091:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658368.453094:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025152384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658368.453140:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025152768:0@lo:400:kworker.0 00000100:00100000:1.0:1788658368.453171:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658368.453192:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025153280:0@lo:400:kworker.0 00000100:00100000:1.0:1788658368.453218:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658368.453236:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025153792:0@lo:400:kworker.0 00000100:00100000:1.0:1788658368.453258:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.453267:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025152256 00000100:00100000:0.0:1788658368.453275:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025152256 00000100:00100000:1.0:1788658368.453327:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788658368.453337:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025152256:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788658368.453373:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d81b3b100 x1875544025154048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658368.453391:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025152256:12345-0@lo:400:kworker.0 Request processed in 56us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658368.453399:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788658368.453473:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025152256:0@lo:400:kworker.0 00000100:00100000:2.0:1788658368.453530:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025154048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658368.453552:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025152768 00000100:00100000:2.0:1788658368.453556:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025152768 00000100:00100000:3.0:1788658368.454081:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025153664:12345-0@lo:400:kworker.0 Request processed in 2529us (2971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.454098:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788658368.454120:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788658368.454127:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025152768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.454167:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025152768:12345-0@lo:400:kworker.0 Request processed in 40us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.454173:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1788658368.454197:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658368.454202:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658368.454205:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658368.454208:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658368.454226:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025153280 00000100:00100000:3.0:1788658368.454230:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025153280 00000100:00100000:3.0:1788658368.454268:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025153792 00000100:00100000:3.0:1788658368.454272:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025153792 00000100:00100000:3.0:1788658368.454295:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788658368.454305:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025153280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.454346:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025153280:12345-0@lo:400:kworker.0 Request processed in 43us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.454355:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788658368.454375:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788658368.454384:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025153792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.454408:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025153792:12345-0@lo:400:kworker.0 Request processed in 27us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.454414:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788658368.454446:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2251500 x1875544025153152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658368.454472:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025153152:0@lo:400:kworker.0 00010000:00080000:3.0:1788658368.454492:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e9836ad80 x1875544025153664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658368.454503:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025153664:0@lo:400:kworker.0 00000100:00080000:3.0:1788658368.454545:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658368.454763:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025152768:0@lo:400:kworker.0 00010000:00080000:1.0:1788658368.454783:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c2300 x1875544025153280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658368.454795:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025153280:0@lo:400:kworker.0 00010000:00080000:1.0:1788658368.454812:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eec700 x1875544025153792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658368.454824:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025153792:0@lo:400:kworker.0 00000100:00100000:3.0:1788658368.698215:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658368.698270:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658368.698300:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658368.698327:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000964480 00000100:00100000:3.0:1788658368.698336:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000964480 00000100:00100000:3.0:1788658368.698393:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000964352 00000100:00100000:3.0:1788658368.698396:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000964352 00000100:00100000:3.0:1788658368.698425:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:3.0:1788658368.698436:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000964480:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658368.698505:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000964480:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 72us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.698513:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:3.0:1788658368.698532:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 114 00000100:00100000:3.0:1788658368.698540:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000964352:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658368.698567:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000964352:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658368.698573:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 114 00000100:00080000:3.0:1788658368.698606:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658368.698611:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658368.698890:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000964224 00000100:00100000:0.0:1788658368.698895:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000964224 00000100:00100000:0.0:1788658368.698938:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 284 00000100:00100000:0.0:1788658368.698945:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544000964224:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658368.698986:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544000964224:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 41us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658368.698994:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 284 00000100:00100000:1.0:1788658368.964739:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025154176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658368.964815:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658368.964847:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025154176 00000100:00100000:0.0:1788658368.964855:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025154176 00000100:00100000:0.0:1788658368.964901:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788658368.964910:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025154176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658368.964942:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658368.964998:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025154176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658368.965006:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1788658368.965250:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb38380 x1875544025154176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658368.965269:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025154176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788658368.972506:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658368.972922:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658368.972946:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025154304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658368.973020:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658368.974571:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025154304 00000100:00100000:1.0:1788658368.974584:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025154304 00000100:00100000:1.0:1788658368.974635:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658368.974645:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025154304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658368.974670:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658368.974764:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025154304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658368.974779:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788658368.974821:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef4380 x1875544025154304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658368.975365:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025154304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658369.471054:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658369.471080:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025154432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658369.471152:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658369.471494:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025154432 00000100:00100000:3.0:1788658369.471504:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025154432 00000100:00100000:3.0:1788658369.471564:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788658369.471574:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025154432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658369.471611:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788658369.471668:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025154432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658369.471675:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788658369.471753:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025154432:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788658369.983684:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658371.008373:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658372.031131:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025154560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658372.031244:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658372.031378:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025154560 00000100:00100000:2.0:1788658372.031391:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025154560 00000100:00100000:2.0:1788658372.031454:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788658372.031467:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025154560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658372.031512:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788658372.031577:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025154560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658372.031585:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788658372.031684:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025154560:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788658372.032138:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658373.059531:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658373.570611:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025154816:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.571022:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025154688:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.571066:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658373.571120:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025155200:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.571147:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658373.571171:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025155712:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.571197:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658373.571217:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025156224:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.571246:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658373.571596:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658373.571630:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025155328:0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.571661:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658373.571680:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025155840:0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.571876:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658373.572002:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025154816 00000100:00100000:2.0:1788658373.572011:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025154816 00000100:00100000:1.0:1788658373.572121:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658373.572130:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025156352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658373.572158:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658373.572190:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025154944:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.572225:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658373.572438:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025155328 00000100:00100000:2.0:1788658373.572443:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025155328 00000100:00100000:2.0:1788658373.573606:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025155840 00000100:00100000:2.0:1788658373.573615:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025155840 00000100:00100000:2.0:1788658373.573639:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788658373.573648:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025154816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.573858:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025155456:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.573900:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658373.573915:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025155968:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.573935:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658373.573946:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025156480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658373.573969:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658373.574008:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788658373.574016:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025155072:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.574040:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658373.574054:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025155584:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.574078:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658373.574100:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025156096:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.574120:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658373.574200:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025154688 00000100:00100000:1.0:1788658373.574205:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025154688 00000100:00100000:1.0:1788658373.574250:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788658373.574258:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025154688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.574301:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025154688:12345-0@lo:400:kworker.0 Request processed in 44us (3235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658373.574309:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788658373.574688:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025154816:12345-0@lo:400:kworker.0 Request processed in 1039us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658373.574697:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788658373.575572:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025155456 00000100:00100000:2.0:1788658373.575583:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025155456 00000100:00100000:2.0:1788658373.575615:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025155968 00000100:00100000:2.0:1788658373.575619:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025155968 00000100:00100000:2.0:1788658373.575629:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025155072 00000100:00100000:2.0:1788658373.575632:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025155072 00000100:00100000:2.0:1788658373.575649:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788658373.575657:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025155328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.576008:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025155328:12345-0@lo:400:kworker.0 Request processed in 351us (4344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658373.576016:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788658373.576032:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788658373.576040:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025155840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.576072:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025155840:12345-0@lo:400:kworker.0 Request processed in 34us (4371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658373.576078:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788658373.576089:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788658373.576095:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025155456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.576141:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025155456:12345-0@lo:400:kworker.0 Request processed in 46us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658373.576148:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788658373.576160:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788658373.576166:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025155968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.576218:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025155968:12345-0@lo:400:kworker.0 Request processed in 52us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658373.576225:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788658373.576238:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788658373.576244:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025155072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.576291:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025155072:12345-0@lo:400:kworker.0 Request processed in 48us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658373.576297:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1788658373.576338:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658373.579543:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025155200 00000100:00100000:1.0:1788658373.579557:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025155200 00000100:00100000:1.0:1788658373.579621:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025154944 00000100:00100000:1.0:1788658373.579625:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025154944 00000100:00100000:1.0:1788658373.579644:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788658373.579653:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025155200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.579759:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025155200:12345-0@lo:400:kworker.0 Request processed in 107us (8610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658373.579768:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788658373.579785:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788658373.579792:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025154944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.579826:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025154944:12345-0@lo:400:kworker.0 Request processed in 35us (7600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658373.579857:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788658373.579888:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025155712 00000100:00100000:1.0:1788658373.579893:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025155712 00000100:00100000:1.0:1788658373.579922:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025156224 00000100:00100000:1.0:1788658373.579925:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025156224 00000100:00100000:1.0:1788658373.579936:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025155584 00000100:00100000:1.0:1788658373.579939:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025155584 00000100:00100000:1.0:1788658373.579953:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025156096 00000100:00100000:1.0:1788658373.579956:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025156096 00000100:00100000:1.0:1788658373.579976:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788658373.579983:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025155712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.580026:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025155712:12345-0@lo:400:kworker.0 Request processed in 44us (8829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658373.580034:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788658373.580052:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788658373.580060:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025156224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.580094:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025156224:12345-0@lo:400:kworker.0 Request processed in 36us (8848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658373.580100:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788658373.580112:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658373.580117:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025155584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.580144:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025155584:12345-0@lo:400:kworker.0 Request processed in 27us (6066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658373.580151:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658373.580161:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788658373.580167:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025156096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.580207:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025156096:12345-0@lo:400:kworker.0 Request processed in 41us (6087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658373.580213:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788658373.580240:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025156352 00000100:00100000:1.0:1788658373.580243:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025156352 00000100:00100000:1.0:1788658373.580259:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025156480 00000100:00100000:1.0:1788658373.580262:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025156480 00000100:00100000:1.0:1788658373.580273:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658373.580279:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025156352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658373.580302:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658373.580335:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025156352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (8176us total) trans 0 rc 0/0 00000100:00080000:2.0:1788658373.582002:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658373.582007:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658373.582010:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658373.582094:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025155072:0@lo:400:kworker.0 00010000:00080000:2.0:1788658373.582113:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377f480 x1875544025155584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658373.582123:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025155584:0@lo:400:kworker.0 00010000:00080000:2.0:1788658373.582140:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d832e7480 x1875544025156096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658373.582148:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025156096:0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.582162:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025154944:0@lo:400:kworker.0 00010000:00080000:2.0:1788658373.582177:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e84433480 x1875544025155456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658373.582184:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025155456:0@lo:400:kworker.0 00010000:00080000:2.0:1788658373.582198:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d832e5f80 x1875544025155968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658373.582224:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025155968:0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.582300:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025154816:0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.582315:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025155328:0@lo:400:kworker.0 00000100:00100000:2.0:1788658373.582327:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025155840:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.584478:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658373.584522:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788658373.584540:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025156480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658373.584568:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658373.584657:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025156480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (10686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658373.584664:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788658373.584775:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e9836ad80 x1875544025156352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658373.584799:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025156352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658373.584815:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025154688:0@lo:400:kworker.0 00000100:00100000:1.0:1788658373.584829:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025155200:0@lo:400:kworker.0 00010000:00080000:2.0:1788658373.586524:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e98369180 x1875544025156480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658373.586548:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025156480:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788658373.587874:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d832e4a80 x1875544025155712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658373.587902:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025155712:0@lo:400:kworker.0 00010000:00080000:1.0:1788658373.587920:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eeaa00 x1875544025156224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658373.587929:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025156224:0@lo:400:kworker.0 00000100:00100000:0.0:1788658373.819928:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658373.819987:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658373.819989:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000964736 00000100:00100000:2.0:1788658373.820000:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000964736 00000100:00100000:0.0:1788658373.820013:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658373.820061:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000964864 00000100:00100000:2.0:1788658373.820065:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000964864 00000100:00100000:0.0:1788658373.820080:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:2.0:1788658373.820086:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:0.0:1788658373.820091:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000964736:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658373.820092:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000964864:12345-192.168.202.53@tcp:400:kworker.0 00000100:00080000:1.0:1788658373.820190:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658373.820195:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658373.820316:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000964864:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 221us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658373.820324:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:3.0:1788658373.820551:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000964608 00000100:00100000:3.0:1788658373.820556:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000964608 00000100:00100000:3.0:1788658373.820650:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 286 00000100:00100000:3.0:1788658373.820659:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544000964608:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658373.824951:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000964736:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 4849us (5021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658373.824967:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:3.0:1788658373.826073:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544000964608:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 5409us (6079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658373.826085:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 286 00000100:00100000:2.0:1788658374.081057:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025156736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658374.081057:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025156608:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788658374.082985:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658374.084589:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658374.087975:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658374.089152:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025156736 00000100:00100000:0.0:1788658374.089152:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025156608 00000100:00100000:1.0:1788658374.089163:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025156736 00000100:00100000:0.0:1788658374.089164:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025156608 00000100:00100000:0.0:1788658374.089221:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788658374.089332:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025156608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658374.089371:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658374.089447:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025156608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 216us (4862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658374.089455:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788658374.089476:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788658374.089483:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025156736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658374.089493:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658374.089525:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025156736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658374.089531:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788658374.089610:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb98380 x1875544025156608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788658374.089633:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e98369180 x1875544025156736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658374.089633:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025156608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658374.089655:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025156736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658374.592126:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658374.592248:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025156864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658374.592328:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658374.593524:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025156864 00000100:00100000:0.0:1788658374.593536:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025156864 00000100:00100000:0.0:1788658374.593589:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788658374.593612:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025156864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658374.593653:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788658374.593733:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025156864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 123us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658374.593740:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788658374.593961:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025156864:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788658375.107110:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658376.130797:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658377.151798:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658377.152509:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025156992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658377.152625:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658377.153029:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025156992 00000100:00100000:2.0:1788658377.153042:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025156992 00000100:00100000:2.0:1788658377.158205:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788658377.158243:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e82e4f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025156992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658377.158301:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788658377.159325:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e82e4f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025156992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1098us (6694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658377.159337:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788658377.164259:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025156992:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788658378.175155:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658378.688460:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658378.688495:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025157120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658378.688618:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658378.688914:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025157120 00000100:00100000:0.0:1788658378.688926:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025157120 00000100:00100000:0.0:1788658378.689019:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788658378.689033:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025157120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658378.689076:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658378.689134:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025157120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658378.689141:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788658378.689213:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788658378.689291:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3a680 x1875544025157120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658378.689314:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025157120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658378.689775:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025157248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658378.689827:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658378.689915:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025157248 00000100:00100000:2.0:1788658378.689921:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025157248 00000100:00100000:2.0:1788658378.689967:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658378.689975:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025157248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658378.690001:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658378.690041:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025157248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658378.690047:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788658378.690074:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef6680 x1875544025157248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658378.690089:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025157248:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788658378.690210:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658378.691274:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025157760:0@lo:400:kworker.0 00000100:00100000:2.0:1788658378.691336:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658378.691400:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025158272:0@lo:400:kworker.0 00000100:00100000:2.0:1788658378.691429:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658378.691453:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788658378.691458:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025157376:0@lo:400:kworker.0 00000100:00100000:2.0:1788658378.691488:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658378.691513:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025157888:0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.693427:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025158272 00000100:00100000:1.0:1788658378.693449:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025158272 00000100:00100000:1.0:1788658378.693551:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788658378.693568:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025158272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.693691:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025158272:12345-0@lo:400:kworker.0 Request processed in 129us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658378.693700:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788658378.693772:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025157376 00000100:00100000:1.0:1788658378.693804:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025157376 00000100:00100000:1.0:1788658378.693840:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788658378.693847:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025157376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.693882:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025157376:12345-0@lo:400:kworker.0 Request processed in 36us (2392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658378.693888:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788658378.693941:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025157632:0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.694031:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658378.694072:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025158144:0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.694099:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658378.694120:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025158656:0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.694140:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658378.694164:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788658378.694171:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025157504:0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.694194:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658378.694213:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025158016:0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.694441:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658378.694455:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025158528:0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.694475:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658378.694503:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025157632 00000100:00100000:1.0:1788658378.694508:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025157632 00000100:00100000:1.0:1788658378.694537:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788658378.694544:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025157632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.694583:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025157632:12345-0@lo:400:kworker.0 Request processed in 39us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658378.694602:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788658378.694622:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025157760 00000100:00100000:1.0:1788658378.694626:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025157760 00000100:00100000:1.0:1788658378.694645:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025158144 00000100:00100000:1.0:1788658378.694648:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025158144 00000100:00100000:1.0:1788658378.694661:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025158656 00000100:00100000:1.0:1788658378.694664:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025158656 00000100:00100000:1.0:1788658378.694675:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025157504 00000100:00100000:1.0:1788658378.694677:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025157504 00000100:00100000:1.0:1788658378.694686:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025158016 00000100:00100000:1.0:1788658378.694688:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025158016 00000100:00100000:1.0:1788658378.694698:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025158528 00000100:00100000:1.0:1788658378.694700:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025158528 00000100:00100000:0.0:1788658378.694892:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788658378.694907:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025157760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658378.694981:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025157760:12345-0@lo:400:kworker.0 Request processed in 78us (3642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658378.695004:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788658378.695036:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788658378.695049:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025158144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658378.695126:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025158144:12345-0@lo:400:kworker.0 Request processed in 78us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658378.695136:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788658378.695152:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788658378.695159:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025158656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658378.695187:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025158656:12345-0@lo:400:kworker.0 Request processed in 30us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658378.695194:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788658378.695208:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788658378.695215:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025157504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658378.695237:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658378.695334:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788658378.695347:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025158016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.695478:0:7958:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788658378.695488:0:7958:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788658378.695510:0:6536:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788658378.695517:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788658378.695524:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025158528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658378.696382:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025157504:12345-0@lo:400:kworker.0 Request processed in 1163us (2182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658378.696391:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788658378.696423:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658378.696428:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658378.696433:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658378.696505:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025157504:0@lo:400:kworker.0 00000100:00100000:0.0:1788658378.696522:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025157632:0@lo:400:kworker.0 00010000:00080000:0.0:1788658378.696538:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8379a680 x1875544025158144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658378.696551:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025158144:0@lo:400:kworker.0 00010000:00080000:0.0:1788658378.696563:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eadba1500 x1875544025158656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658378.696572:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025158656:0@lo:400:kworker.0 00000100:00100000:0.0:1788658378.696665:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025157888 00000100:00100000:0.0:1788658378.696672:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025157888 00000100:00100000:0.0:1788658378.696728:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788658378.696747:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025157888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658378.696834:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025157888:12345-0@lo:400:kworker.0 Request processed in 97us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658378.696846:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788658378.701225:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025157888:0@lo:400:kworker.0 00000100:00100000:2.0:1788658378.701245:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025158400:0@lo:400:kworker.0 00000100:00100000:2.0:1788658378.701312:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658378.701365:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025157760:0@lo:400:kworker.0 00010000:00080000:2.0:1788658378.701382:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83798e00 x1875544025158272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658378.701393:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025158272:0@lo:400:kworker.0 00000100:00100000:2.0:1788658378.701424:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025157376:0@lo:400:kworker.0 00000100:00100000:0.0:1788658378.701953:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025158400 00000100:00100000:0.0:1788658378.701969:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025158400 00000100:00100000:0.0:1788658378.702085:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788658378.702105:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025158400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658378.702267:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025158400:12345-0@lo:400:kworker.0 Request processed in 167us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658378.702302:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788658378.702344:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788658378.705155:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8379b100 x1875544025158400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658378.705174:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025158400:0@lo:400:kworker.0 00000100:00100000:3.0:1788658378.707055:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025158016:12345-0@lo:400:kworker.0 Request processed in 11696us (12597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658378.707075:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788658378.708090:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025158016:0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.710130:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025158528:12345-0@lo:400:kworker.0 Request processed in 14592us (15639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658378.710149:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788658378.720907:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025158528:0@lo:400:kworker.0 00000100:00100000:1.0:1788658378.938934:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658378.939004:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658378.939045:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658378.939186:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000964992 00000100:00100000:3.0:1788658378.939200:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000964992 00000100:00100000:3.0:1788658378.939287:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 288 00000100:00100000:3.0:1788658378.939300:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:2396:x1875544000964992:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658378.939391:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+10:2396:x1875544000964992:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 94us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658378.939400:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 288 00000100:00100000:2.0:1788658378.949897:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000965120 00000100:00100000:2.0:1788658378.949926:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000965120 00000100:00100000:2.0:1788658378.950065:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000965248 00000100:00100000:2.0:1788658378.950071:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000965248 00000100:00100000:2.0:1788658378.950124:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:3.0:1788658378.950637:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 130 00000100:00100000:3.0:1788658378.950650:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000965248:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658378.950837:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000965248:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 188us (11787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658378.950852:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 130 00000100:00080000:1.0:1788658378.951453:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658378.951463:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658378.952062:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544000965120:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658378.952848:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544000965120:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 2703us (13921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658378.952862:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 129 00010000:00010000:2.0:1788658379.199859:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658379.200214:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025158784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658379.200310:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658379.200460:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025158784 00000100:00100000:0.0:1788658379.200471:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025158784 00000100:00100000:0.0:1788658379.200540:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788658379.200552:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025158784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658379.200603:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658379.200667:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025158784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658379.200675:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788658379.200950:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb38700 x1875544025158784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658379.200982:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025158784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658379.203102:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658379.203142:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025158912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658379.203255:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658379.203518:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025158912 00000100:00100000:0.0:1788658379.203552:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025158912 00000100:00100000:0.0:1788658379.203645:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788658379.203662:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025158912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658379.203700:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658379.203838:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025158912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658379.203850:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788658379.204523:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb39500 x1875544025158912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658379.204560:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025158912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658379.713219:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025159040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658379.713316:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658379.713554:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025159040 00000100:00100000:3.0:1788658379.713566:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025159040 00000100:00100000:3.0:1788658379.713633:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788658379.713644:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025159040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658379.713689:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788658379.713773:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025159040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658379.713780:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788658379.714465:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025159040:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788658380.225599:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658380.384600:0:12011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:32:57 (1788658377) === 00000100:00100000:0.0:1788658380.787153:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.787323:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000965376 00000100:00100000:2.0:1788658380.787337:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000965376 00000100:00100000:2.0:1788658380.787411:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 289 00000100:00100000:2.0:1788658380.787425:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+10:8717:x1875544000965376:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658380.787450:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658380.787472:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390600/0x48e67cc629c6e9a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc645 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658380.787504:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390600/0x48e67cc629c6e9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc645 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658380.787515:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390600/0x48e67cc629c6e9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc645 expref: 11 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658380.787540:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390600, rc 0) 00000100:00100000:2.0:1788658380.787610:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+11:8717:x1875544000965376:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 189us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658380.787616:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 289 00000100:00100000:1.0:1788658380.791544:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.796215:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000965504 00000100:00100000:2.0:1788658380.796495:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000965504 00000100:00100000:2.0:1788658380.796626:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 290 00000100:00100000:2.0:1788658380.796640:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+11:8717:x1875544000965504:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788658380.799163:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+11:8717:x1875544000965504:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 2513us (7616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658380.799177:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 290 00000100:00100000:0.0:1788658380.804800:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658380.807394:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000965632 00000100:00100000:3.0:1788658380.807417:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000965632 00000100:00100000:3.0:1788658380.807592:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 291 00000100:00100000:3.0:1788658380.807607:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+11:8717:x1875544000965632:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788658380.807851:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+11:8717:x1875544000965632:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 247us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658380.807860:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 291 00000100:00100000:3.0:1788658380.827602:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.827887:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000965760 00000100:00100000:2.0:1788658380.827905:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000965760 00000100:00100000:2.0:1788658380.827997:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 292 00000100:00100000:2.0:1788658380.828015:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+11:8721:x1875544000965760:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658380.830127:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+11:8721:x1875544000965760:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 2038us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658380.830148:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 292 00000100:00100000:1.0:1788658380.847632:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.848206:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000965888 00000100:00100000:2.0:1788658380.848222:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000965888 00000100:00100000:2.0:1788658380.848344:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 293 00000100:00100000:2.0:1788658380.848358:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+11:8721:x1875544000965888:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658380.848610:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+11:8721:x1875544000965888:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 253us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658380.848620:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 293 00000100:00100000:1.0:1788658380.853442:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658380.855294:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000966016 00000100:00100000:0.0:1788658380.855315:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000966016 00000100:00100000:0.0:1788658380.855398:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 294 00000100:00100000:0.0:1788658380.855411:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+11:8721:x1875544000966016:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658380.855628:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+11:8721:x1875544000966016:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 219us (2201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658380.855637:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 294 00000100:00100000:1.0:1788658380.860207:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.860291:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000966144 00000100:00100000:2.0:1788658380.860305:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000966144 00000100:00100000:2.0:1788658380.860398:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 295 00000100:00100000:2.0:1788658380.860410:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+11:8717:x1875544000966144:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658380.860433:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658380.860458:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e9aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc676 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658380.860493:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc676 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658380.860506:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc676 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658380.860517:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390200, rc 0) 00000100:00100000:2.0:1788658380.860629:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+12:8717:x1875544000966144:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 220us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658380.860636:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 295 00000100:00100000:1.0:1788658380.866293:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.867002:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000966272 00000100:00100000:2.0:1788658380.867020:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000966272 00000100:00100000:2.0:1788658380.867224:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 296 00000100:00100000:2.0:1788658380.867237:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+12:8717:x1875544000966272:12345-192.168.202.53@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788658380.867276:0:6529:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788658380.867312:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788658380.867317:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788658380.867321:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788658380.867324:0:6529:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788658380.867326:0:6529:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788658380.872075:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+12:8717:x1875544000966272:12345-192.168.202.53@tcp:256:mount.lustre.0 Request processed in 4814us (5771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658380.872113:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 296 00000100:00100000:1.0:1788658380.875876:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658380.876041:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000966400 00000100:00100000:0.0:1788658380.876055:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000966400 00000100:00100000:0.0:1788658380.876142:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 297 00000100:00100000:0.0:1788658380.876155:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+12:8717:x1875544000966400:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788658380.876177:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658380.876202:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e9b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc67d expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658380.876266:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc67d expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658380.876278:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc67d expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658380.876288:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d0400, rc 0) 00000100:00100000:0.0:1788658380.876371:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:8717:x1875544000966400:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 218us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658380.876379:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 297 00000100:00100000:1.0:1788658380.878427:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.878610:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000966528 00000100:00100000:2.0:1788658380.878623:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000966528 00000100:00100000:2.0:1788658380.878700:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 298 00000100:00100000:2.0:1788658380.878976:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:8717:x1875544000966528:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788658380.879182:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:8717:x1875544000966528:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 211us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658380.881411:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658380.881588:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000966656 00000100:00100000:3.0:1788658380.881602:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000966656 00000100:00100000:2.0:1788658380.882148:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 298 00000100:00100000:3.0:1788658380.882308:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 299 00000100:00100000:3.0:1788658380.882322:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:8717:x1875544000966656:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788658380.882537:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:8717:x1875544000966656:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 218us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658380.882545:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 299 00000100:00100000:1.0:1788658380.886942:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.887203:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000966784 00000100:00100000:2.0:1788658380.887218:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000966784 00000100:00100000:2.0:1788658380.887340:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 300 00000100:00100000:2.0:1788658380.887354:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:8725:x1875544000966784:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658380.887684:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:8725:x1875544000966784:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 332us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658380.887694:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 300 00000100:00100000:1.0:1788658380.896334:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658380.914227:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000966912 00000100:00100000:0.0:1788658380.914251:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000966912 00000100:00100000:0.0:1788658380.914344:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 301 00000100:00100000:0.0:1788658380.914357:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:8725:x1875544000966912:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658380.914580:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:8725:x1875544000966912:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 225us (18261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658380.914589:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 301 00000100:00100000:1.0:1788658380.919987:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658380.920153:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658380.920582:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.920643:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000967680 00000100:00100000:2.0:1788658380.920656:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000967680 00000100:00100000:2.0:1788658380.920759:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000967808 00000100:00100000:2.0:1788658380.920763:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000967808 00000100:00100000:2.0:1788658380.920802:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:2.0:1788658380.920814:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544000967680:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658380.920915:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544000967680:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 103us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658380.920923:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:2.0:1788658380.920943:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:2.0:1788658380.920958:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000967808:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658380.920983:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000967808:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658380.920990:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00080000:0.0:1788658380.921166:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658380.921172:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658380.921649:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658380.922314:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000967040 00000100:00100000:3.0:1788658380.922325:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000967040 00000100:00100000:1.0:1788658380.923111:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000967296 00000100:00100000:1.0:1788658380.923120:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000967296 00000100:00100000:1.0:1788658380.923157:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:1.0:1788658380.923166:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1875544000967040:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788658380.923201:0:11974:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bab2558f-23d6-4f42-bb42-9568fb514d36@192.168.202.53@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:1.0:1788658380.923245:0:11974:0:(genops.c:1385:class_connect()) connect: client bab2558f-23d6-4f42-bb42-9568fb514d36, cookie 0x48e67cc629c6e9b8 00000004:00100000:1.0:1788658380.923279:0:11974:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788658380.923452:0:11974:0:(import.c:65:import_set_state_nolock()) ffff8a1eb744e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658380.923527:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2395:x1875544000967040:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 360us (2944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658380.923534:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:1.0:1788658380.923554:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:1.0:1788658380.923570:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2395:x1875544000967296:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788658380.923586:0:11974:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from bab2558f-23d6-4f42-bb42-9568fb514d36@192.168.202.53@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:1.0:1788658380.923609:0:11974:0:(genops.c:1385:class_connect()) connect: client bab2558f-23d6-4f42-bb42-9568fb514d36, cookie 0x48e67cc629c6e9bf 00000004:00100000:1.0:1788658380.923624:0:11974:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788658380.924076:0:11974:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7449800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658380.924104:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83469f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2395:x1875544000967296:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 533us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658380.924112:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:1.0:1788658380.928036:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658380.928178:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658380.928299:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658380.928800:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000967424 00000100:00100000:0.0:1788658380.928814:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000967424 00000100:00100000:0.0:1788658380.928902:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000967168 00000100:00100000:0.0:1788658380.928906:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000967168 00000100:00100000:0.0:1788658380.928930:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1788658380.928941:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+6:0:x1875544000967424:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788658380.928991:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00080000:3.0:1788658380.929177:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658380.929182:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658380.929315:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+6:0:x1875544000967424:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 375us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658380.929323:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1788658380.929344:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:0.0:1788658380.929351:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+6:0:x1875544000967168:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788658380.929368:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788658380.929498:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83468a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+6:0:x1875544000967168:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 147us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658380.929504:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:1.0:1788658380.929599:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000967552 00000100:00100000:1.0:1788658380.929603:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000967552 00000100:00100000:1.0:1788658380.929629:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:1.0:1788658380.929635:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+6:8717:x1875544000967552:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788658380.929647:0:7958:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788658380.929681:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83468380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+6:8717:x1875544000967552:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 46us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658380.929688:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:3.0:1788658380.931905:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658380.932329:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000967936 00000100:00100000:1.0:1788658380.932342:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000967936 00000100:00100000:1.0:1788658380.932621:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:1.0:1788658380.932633:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+6:8717:x1875544000967936:12345-192.168.202.53@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788658380.932778:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+6:8717:x1875544000967936:12345-192.168.202.53@tcp:40:mount.lustre.0 Request processed in 146us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658380.932802:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1788658380.935298:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.935356:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658380.935404:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658380.935738:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000968320 00000100:00100000:3.0:1788658380.935752:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000968320 00000100:00100000:3.0:1788658380.935829:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1788658380.935842:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bab2558f-23d6-4f42-bb42-9568fb514d36+6:8717:x1875544000968320:12345-192.168.202.53@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788658380.935942:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bab2558f-23d6-4f42-bb42-9568fb514d36+6:8717:x1875544000968320:12345-192.168.202.53@tcp:900:mount.lustre.0 Request processed in 103us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658380.935951:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1788658380.936311:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000968064 00000100:00100000:2.0:1788658380.936316:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000968064 00000100:00100000:2.0:1788658380.936349:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000968192 00000100:00100000:2.0:1788658380.936352:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000968192 00000100:00100000:2.0:1788658380.936371:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1788658380.936513:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:0.0:1788658380.936519:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1875544000968192:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788658380.936554:0:8454:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bab2558f-23d6-4f42-bb42-9568fb514d36@192.168.202.53@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:0.0:1788658380.936591:0:8454:0:(genops.c:1385:class_connect()) connect: client bab2558f-23d6-4f42-bb42-9568fb514d36, cookie 0x48e67cc629c6e9c6 00002000:00100000:0.0:1788658380.936605:0:8454:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bab2558f-23d6-4f42-bb42-9568fb514d36/ffff8a1d835f2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658380.936629:0:8454:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658380.936760:0:8454:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788658380.936807:0:8454:0:(import.c:65:import_set_state_nolock()) ffff8a1d835f3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658380.936849:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2395:x1875544000968192:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 328us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658380.936857:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1788658380.936973:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1875544000968064:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788658380.936993:0:8453:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bab2558f-23d6-4f42-bb42-9568fb514d36@192.168.202.53@tcp t0 exp 0000000000000000 cur 298 last 0 00000020:00000080:2.0:1788658380.937016:0:8453:0:(genops.c:1385:class_connect()) connect: client bab2558f-23d6-4f42-bb42-9568fb514d36, cookie 0x48e67cc629c6e9cd 00002000:00100000:2.0:1788658380.937022:0:8453:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bab2558f-23d6-4f42-bb42-9568fb514d36/ffff8a1eb5e64000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788658380.937035:0:8453:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788658380.937151:0:8453:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788658380.937169:0:8453:0:(import.c:65:import_set_state_nolock()) ffff8a1eb5e65000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658380.937197:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2395:x1875544000968064:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 818us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658380.937204:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:1.0:1788658380.940468:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658380.940570:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000968448 00000100:00100000:3.0:1788658380.940583:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000968448 00000100:00100000:3.0:1788658380.940781:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:3.0:1788658380.940794:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+6:8717:x1875544000968448:12345-192.168.202.53@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788658380.943125:0:6539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788658380.943351:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+6:8717:x1875544000968448:12345-192.168.202.53@tcp:33:mount.lustre.0 Request processed in 2554us (2891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658380.943363:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00010000:00010000:0.0:1788658381.247252:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658382.271796:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025159168:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658382.271872:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658382.271988:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025159168 00000100:00100000:2.0:1788658382.271996:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025159168 00010000:00010000:0.0:1788658382.272003:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658382.272052:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788658382.272071:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025159168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658382.272118:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788658382.272186:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025159168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658382.272193:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788658382.272296:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025159168:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788658383.294873:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658383.807003:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025159296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658383.807081:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658383.807167:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025159296 00000100:00100000:2.0:1788658383.807175:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025159296 00000100:00100000:2.0:1788658383.807228:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788658383.807238:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025159296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658383.807269:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658383.807312:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025159296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658383.807320:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788658383.807340:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788658383.807387:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c3b80 x1875544025159296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658383.807405:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025159296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658383.808083:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025159552:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808142:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.808166:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025160064:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808188:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.808204:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025160576:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808237:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.808263:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788658383.808270:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025159680:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808296:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.808313:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025160192:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808333:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.808360:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025160704:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808379:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.808419:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025159552 00000100:00100000:1.0:1788658383.808423:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025159552 00000100:00100000:1.0:1788658383.808459:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025160064 00000100:00100000:1.0:1788658383.808462:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025160064 00000100:00100000:1.0:1788658383.808484:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025160576 00000100:00100000:1.0:1788658383.808486:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025160576 00000100:00100000:1.0:1788658383.808497:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025160192 00000100:00100000:1.0:1788658383.808499:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025160192 00000100:00100000:1.0:1788658383.808510:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025160704 00000100:00100000:1.0:1788658383.808512:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025160704 00000100:00100000:1.0:1788658383.808526:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788658383.808532:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025159552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808579:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025159552:12345-0@lo:400:kworker.0 Request processed in 46us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.808587:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788658383.808604:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788658383.808611:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025160064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808638:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025160064:12345-0@lo:400:kworker.0 Request processed in 28us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.808644:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788658383.808656:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788658383.808662:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025160576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808691:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025160576:12345-0@lo:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.808697:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788658383.808740:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788658383.808747:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025160192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808774:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025160192:12345-0@lo:400:kworker.0 Request processed in 28us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.808780:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788658383.808925:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788658383.808936:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025160704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.808965:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025160704:12345-0@lo:400:kworker.0 Request processed in 32us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.808971:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788658383.808993:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025159680 00000100:00100000:1.0:1788658383.808998:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025159680 00000100:00100000:1.0:1788658383.809034:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788658383.809040:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025159680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809072:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025159680:12345-0@lo:400:kworker.0 Request processed in 32us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.809078:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788658383.809103:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658383.809107:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658383.809118:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025159808:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809142:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.809158:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025160320:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809181:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.809200:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025160832:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.809238:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788658383.809244:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025159424:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809270:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.809293:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025159936:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809314:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.809331:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025160448:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809368:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658383.809395:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025160320 00000100:00100000:1.0:1788658383.809399:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025160320 00000100:00100000:1.0:1788658383.809427:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025160832 00000100:00100000:1.0:1788658383.809431:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025160832 00000100:00100000:1.0:1788658383.809456:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025160448 00000100:00100000:1.0:1788658383.809460:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025160448 00000100:00100000:1.0:1788658383.809475:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658383.809490:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025160320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809525:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025160320:12345-0@lo:400:kworker.0 Request processed in 37us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.809532:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658383.809544:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658383.809550:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025160832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809578:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025160832:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.809584:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658383.809593:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788658383.809599:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025160448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809626:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025160448:12345-0@lo:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.809632:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788658383.809648:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025159424 00000100:00100000:1.0:1788658383.809652:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025159424 00000100:00100000:1.0:1788658383.809675:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788658383.809682:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025159424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.809733:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025159424:12345-0@lo:400:kworker.0 Request processed in 52us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.809740:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788658383.809766:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025159936 00000100:00100000:1.0:1788658383.809769:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025159936 00000100:00100000:1.0:1788658383.809787:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788658383.810218:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025159808 00000100:00100000:2.0:1788658383.810222:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025159808 00000100:00100000:2.0:1788658383.810252:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788658383.810259:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025159808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658383.810297:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025159808:12345-0@lo:400:kworker.0 Request processed in 39us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658383.810304:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788658383.810976:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025160960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658383.811021:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658383.811535:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025160960 00000100:00100000:2.0:1788658383.811542:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025160960 00000100:00100000:2.0:1788658383.811585:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788658383.811592:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025160960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658383.811613:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658383.811658:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025160960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658383.811666:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788658383.811700:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c3b80 x1875544025160960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658383.812974:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025159936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.813045:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025159936:12345-0@lo:400:kworker.0 Request processed in 3252us (3729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658383.813066:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788658383.813110:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658383.813115:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658383.813154:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025159680:0@lo:400:kworker.0 00010000:00080000:1.0:1788658383.813172:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8346b480 x1875544025160192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658383.813182:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025160192:0@lo:400:kworker.0 00010000:00080000:1.0:1788658383.813196:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83468000 x1875544025160704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658383.813205:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025160704:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.813219:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025159552:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.813233:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025160064:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.813246:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025160576:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.813308:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025159424:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.813319:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025159936:0@lo:400:kworker.0 00010000:00080000:1.0:1788658383.813333:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8346aa00 x1875544025160448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658383.813357:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025160448:0@lo:400:kworker.0 00000100:00100000:1.0:1788658383.813372:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025159808:0@lo:400:kworker.0 00010000:00080000:1.0:1788658383.813385:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83469880 x1875544025160320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658383.813416:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025160320:0@lo:400:kworker.0 00010000:00080000:1.0:1788658383.813431:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8346a300 x1875544025160832/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658383.813439:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025160832:0@lo:400:kworker.0 00000100:00100000:2.0:1788658383.813624:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025160960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658384.319151:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025161088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658384.319224:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658384.319352:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025161088 00000100:00100000:3.0:1788658384.319360:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025161088 00000100:00100000:3.0:1788658384.319420:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788658384.319431:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025161088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658384.319475:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658384.319678:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025161088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658384.319686:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1788658384.322348:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:1.0:1788658384.325368:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c3b80 x1875544025161088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658384.325420:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025161088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658384.325452:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658384.325464:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025161216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658384.325528:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658384.325631:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025161216 00000100:00100000:3.0:1788658384.325638:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025161216 00000100:00100000:3.0:1788658384.325697:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788658384.325724:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025161216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658384.325759:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658384.325809:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83756a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025161216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658384.325816:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1788658384.326102:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3b800 x1875544025161216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658384.326117:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025161216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658384.838160:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658384.838187:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025161344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658384.838273:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658384.838350:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025161344 00000100:00100000:3.0:1788658384.838358:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025161344 00000100:00100000:3.0:1788658384.838405:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788658384.838414:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025161344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658384.838448:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788658384.838499:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025161344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658384.838506:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788658384.838565:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025161344:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658385.344734:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658386.107299:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658386.107344:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658386.107377:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658386.107412:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658386.107435:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658386.107457:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658386.107495:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658386.107526:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000969344 00000100:00100000:1.0:1788658386.107534:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000969344 00000100:00100000:1.0:1788658386.107602:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000969216 00000100:00100000:1.0:1788658386.107606:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000969216 00000100:00100000:1.0:1788658386.107630:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:1.0:1788658386.107641:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2396:x1875544000969344:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658386.107759:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2396:x1875544000969344:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 119us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658386.107766:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:1.0:1788658386.107785:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:1.0:1788658386.107792:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2396:x1875544000969216:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658386.107816:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2396:x1875544000969216:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658386.107823:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:1.0:1788658386.107843:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000968832 00000100:00100000:1.0:1788658386.107846:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000968832 00000100:00100000:1.0:1788658386.107870:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000969088 00000100:00100000:1.0:1788658386.107873:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000969088 00000100:00100000:1.0:1788658386.107885:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000968704 00000100:00100000:1.0:1788658386.107887:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000968704 00000100:00100000:1.0:1788658386.107899:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000968960 00000100:00100000:1.0:1788658386.107902:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000968960 00000100:00100000:1.0:1788658386.107915:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00100000:1.0:1788658386.107921:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000968832:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658386.107949:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000968832:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658386.107956:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00100000:1.0:1788658386.107967:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 140 00000100:00100000:1.0:1788658386.107973:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2396:x1875544000969088:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658386.108009:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2396:x1875544000969088:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 35us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658386.108026:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 140 00000100:00100000:1.0:1788658386.108038:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 141 00000100:00100000:1.0:1788658386.108044:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544000968704:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658386.108070:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544000968704:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658386.108078:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 141 00000100:00100000:1.0:1788658386.108090:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 142 00000100:00100000:1.0:1788658386.108095:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2396:x1875544000968960:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658386.108117:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2396:x1875544000968960:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 21us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658386.108122:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 142 00000100:00080000:1.0:1788658386.108141:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658386.108145:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658386.108148:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788658386.108150:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658386.108450:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000968576 00000100:00100000:3.0:1788658386.108456:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000968576 00000100:00100000:3.0:1788658386.108498:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 303 00000100:00100000:3.0:1788658386.108505:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2396:x1875544000968576:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658386.108538:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2396:x1875544000968576:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 34us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658386.108545:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 303 00010000:00010000:2.0:1788658386.367046:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788658386.887205:0:7466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bab2558f-23d6-4f42-bb42-9568fb514d36 00000001:00100000:1.0:1788658386.888183:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bab2558f-23d6-4f42-bb42-9568fb514d36 00000001:00100000:0.0:1788658386.889756:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bab2558f-23d6-4f42-bb42-9568fb514d36 00000001:00100000:3.0:1788658386.890461:0:6515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bab2558f-23d6-4f42-bb42-9568fb514d36 00000100:00100000:1.0:1788658387.391255:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658387.391283:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025161472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788658387.391333:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658387.391359:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658387.391485:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025161472 00000100:00100000:3.0:1788658387.391493:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025161472 00000100:00100000:3.0:1788658387.391541:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788658387.391552:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025161472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658387.391589:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658387.391651:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83469880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025161472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658387.391657:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788658387.391756:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025161472:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788658388.417070:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658388.538173:0:12205:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1788658388.930579:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025161728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658388.930649:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658388.930723:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658388.930731:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025161600:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658388.930756:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658388.930788:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025161728 00000100:00100000:2.0:1788658388.930795:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025161728 00000100:00100000:2.0:1788658388.930839:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025161600 00000100:00100000:2.0:1788658388.930842:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025161600 00000100:00100000:2.0:1788658388.930861:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788658388.930870:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025161728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658388.930911:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658388.930972:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025161728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658388.930979:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788658388.930995:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788658388.931001:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025161600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658388.931011:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658388.931034:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025161600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658388.931039:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788658388.931071:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c1f80 x1875544025161600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658388.931089:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025161600:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788658388.931102:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c0a80 x1875544025161728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658388.931112:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025161728:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788658388.935824:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658388.935845:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025161984:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.935924:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658388.935966:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025162496:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.935990:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658388.936019:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025163008:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.936042:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658388.936170:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025161856:0@lo:400:kworker.0 00000100:00100000:3.0:1788658388.936206:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658388.936231:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025162368:0@lo:400:kworker.0 00000100:00100000:3.0:1788658388.936256:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658388.936274:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025162880:0@lo:400:kworker.0 00000100:00100000:3.0:1788658388.936296:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658388.936343:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025161856 00000100:00100000:3.0:1788658388.936350:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025161856 00000100:00100000:3.0:1788658388.936409:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788658388.936419:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025161856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658388.936469:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025161856:12345-0@lo:400:kworker.0 Request processed in 52us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658388.936477:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788658388.936509:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025162368 00000100:00100000:3.0:1788658388.936513:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025162368 00000100:00100000:3.0:1788658388.936536:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788658388.936543:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025162368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658388.936575:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025162368:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658388.936581:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788658388.936596:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025162880 00000100:00100000:3.0:1788658388.936600:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025162880 00000100:00100000:3.0:1788658388.936635:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788658388.936641:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025162880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658388.936668:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025162880:12345-0@lo:400:kworker.0 Request processed in 28us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658388.936673:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788658388.936723:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025161856:0@lo:400:kworker.0 00000100:00100000:3.0:1788658388.936735:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025162368:0@lo:400:kworker.0 00010000:00080000:3.0:1788658388.936746:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8346b480 x1875544025162880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658388.936755:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025162880:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.937172:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025162112:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.937203:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658388.937231:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025162624:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.937254:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658388.937273:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025163136:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.937295:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658388.937314:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788658388.937319:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025162240:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.937342:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658388.937352:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025162752:0@lo:400:kworker.0 00000100:00100000:2.0:1788658388.937847:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025161984 00000100:00100000:2.0:1788658388.937853:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025161984 00000100:00100000:1.0:1788658388.937921:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658388.937950:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025162496 00000100:00100000:1.0:1788658388.937955:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025162496 00000100:00100000:1.0:1788658388.937977:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025163008 00000100:00100000:1.0:1788658388.937979:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025163008 00000100:00100000:1.0:1788658388.937990:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025162624 00000100:00100000:1.0:1788658388.937992:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025162624 00000100:00100000:1.0:1788658388.938002:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025163136 00000100:00100000:1.0:1788658388.938004:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025163136 00000100:00100000:1.0:1788658388.938013:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025162240 00000100:00100000:1.0:1788658388.938016:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025162240 00000100:00100000:1.0:1788658388.938026:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788658388.938033:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025162496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658388.938163:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025162112 00000100:00100000:3.0:1788658388.938168:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025162112 00000100:00100000:3.0:1788658388.938195:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788658388.938200:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025162112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658388.938241:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788658388.938249:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025163008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658388.945901:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025162112:12345-0@lo:400:kworker.0 Request processed in 7690us (8687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658388.945916:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788658388.945992:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025162112:0@lo:400:kworker.0 00000100:00100000:2.0:1788658388.950117:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025163008:12345-0@lo:400:kworker.0 Request processed in 11861us (14065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658388.950133:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788658388.950173:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788658388.950185:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025162624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658388.950241:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025162624:12345-0@lo:400:kworker.0 Request processed in 61us (12986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658388.950261:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788658388.950275:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788658388.950283:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025163136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658388.950317:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025163136:12345-0@lo:400:kworker.0 Request processed in 36us (13021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658388.950323:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788658388.950335:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788658388.950341:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025162240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658388.950373:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025162240:12345-0@lo:400:kworker.0 Request processed in 32us (13031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658388.950378:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788658388.950390:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788658388.950397:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025161984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658388.950431:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025161984:12345-0@lo:400:kworker.0 Request processed in 34us (14506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658388.950436:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788658388.950966:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025162240:0@lo:400:kworker.0 00010000:00080000:3.0:1788658388.950985:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83468700 x1875544025162624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658388.950997:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025162624:0@lo:400:kworker.0 00010000:00080000:3.0:1788658388.951009:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83497100 x1875544025163136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658388.951017:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025163136:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.956650:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025162496:12345-0@lo:400:kworker.0 Request processed in 18607us (20649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658388.956667:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1788658388.956747:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658388.956754:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658388.956758:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658388.956774:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025162752 00000100:00100000:1.0:1788658388.956782:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025162752 00000100:00100000:1.0:1788658388.956836:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788658388.956846:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025162752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.956930:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025162752:12345-0@lo:400:kworker.0 Request processed in 86us (19009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658388.956937:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788658388.956988:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025161984:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.957001:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025162496:0@lo:400:kworker.0 00000100:00100000:1.0:1788658388.957014:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025163008:0@lo:400:kworker.0 00000100:00080000:3.0:1788658388.957150:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788658388.957175:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83468000 x1875544025162752/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658388.957186:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83468000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025162752:0@lo:400:kworker.0 00000100:00100000:1.0:1788658389.439084:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025163264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658389.439170:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658389.439358:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025163264 00000100:00100000:2.0:1788658389.439367:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025163264 00000100:00100000:2.0:1788658389.439421:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788658389.439432:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025163264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658389.439462:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658389.439524:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025163264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658389.439531:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788658389.440104:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c0a80 x1875544025163264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658389.440125:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025163264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788658389.440508:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658389.440733:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025163392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658389.440781:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658389.440884:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025163392 00000100:00100000:2.0:1788658389.440890:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025163392 00000100:00100000:2.0:1788658389.440933:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788658389.440943:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025163392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788658389.440961:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658389.441013:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025163392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658389.441020:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1788658389.441294:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3b800 x1875544025163392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658389.441322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025163392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658389.952135:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025163520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658389.952208:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658389.967748:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025163520 00000100:00100000:3.0:1788658389.967768:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025163520 00000100:00100000:3.0:1788658389.968156:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788658389.968168:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025163520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658389.968206:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788658389.968300:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025163520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (16091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658389.968308:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788658389.968411:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025163520:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658390.462822:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658391.238038:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658391.238081:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658391.238105:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658391.238126:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658391.238146:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658391.238178:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658391.238249:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658391.238279:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000969472 00000100:00100000:1.0:1788658391.238290:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000969472 00000100:00100000:1.0:1788658391.238346:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 305 00000100:00100000:1.0:1788658391.238356:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000969472:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658391.238420:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000969472:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 66us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658391.238429:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 305 00000100:00100000:1.0:1788658391.238461:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000969728 00000100:00100000:1.0:1788658391.238465:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000969728 00000100:00100000:1.0:1788658391.238502:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000969984 00000100:00100000:1.0:1788658391.238504:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000969984 00000100:00100000:1.0:1788658391.238516:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000969600 00000100:00100000:1.0:1788658391.238518:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000969600 00000100:00100000:1.0:1788658391.238532:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000969856 00000100:00100000:1.0:1788658391.238534:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000969856 00000100:00100000:1.0:1788658391.238547:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 149 00000100:00100000:1.0:1788658391.238553:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000969728:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658391.238585:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000969728:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 32us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658391.238592:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 149 00000100:00100000:1.0:1788658391.238605:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 150 00000100:00100000:1.0:1788658391.238611:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000969984:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658391.238649:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000969984:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 38us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658391.238656:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 150 00000100:00100000:1.0:1788658391.238676:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 151 00000100:00100000:1.0:1788658391.238683:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000969600:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658391.238736:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000969600:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 53us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658391.238743:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 151 00000100:00100000:1.0:1788658391.238757:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 152 00000100:00100000:1.0:1788658391.238762:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000969856:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658391.238785:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000969856:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658391.238791:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 152 00000100:00100000:3.0:1788658391.244590:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000970240 00000100:00100000:3.0:1788658391.244607:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000970240 00000100:00100000:3.0:1788658391.244725:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000970112 00000100:00100000:3.0:1788658391.244730:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000970112 00000100:00100000:3.0:1788658391.244763:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:3.0:1788658391.244774:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000970240:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658391.244954:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:1.0:1788658391.244965:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000970112:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658391.245027:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000970112:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 65us (6777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658391.245035:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:3.0:1788658391.245584:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000970240:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 810us (7454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658391.245594:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00080000:3.0:1788658391.245633:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658391.245637:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658391.245641:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658391.245645:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788658391.487118:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658392.514036:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658392.514206:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025163648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658392.514284:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658392.514867:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025163648 00000100:00100000:1.0:1788658392.514877:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025163648 00000100:00100000:1.0:1788658392.514932:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788658392.514942:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025163648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658392.514976:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788658392.515037:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025163648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658392.515044:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788658392.515134:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025163648:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788658393.541962:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658394.059639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025163904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658394.059734:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658394.059808:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025163904 00000100:00100000:3.0:1788658394.059815:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025163904 00000100:00100000:3.0:1788658394.059868:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788658394.059877:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025163904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788658394.059908:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658394.059954:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025163904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658394.059961:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788658394.060159:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788658394.060193:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eadba0e00 x1875544025163904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658394.060228:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025163904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658394.065042:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025163776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658394.065127:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658394.065776:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025163776 00000100:00100000:3.0:1788658394.065788:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025163776 00000100:00100000:3.0:1788658394.065850:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658394.065861:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025163776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788658394.065892:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658394.065958:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025163776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658394.065964:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788658394.065991:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788658394.067752:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c1f80 x1875544025163776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658394.067782:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025163776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658394.068827:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025164160:0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.068894:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658394.068938:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025164672:0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.068963:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658394.068988:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025165184:0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.069011:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658394.069038:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788658394.069044:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025164288:0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.069071:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658394.069092:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025164800:0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.069114:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658394.069132:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025165312:0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.069153:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658394.069184:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025164160 00000100:00100000:2.0:1788658394.069190:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025164160 00000100:00100000:0.0:1788658394.069726:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025164032:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.069767:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658394.069795:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025164544:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.069818:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658394.069834:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025165056:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.069856:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658394.069878:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788658394.069885:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025164416:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.069905:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658394.069917:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025164928:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.069937:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658394.069964:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025164032 00000100:00100000:0.0:1788658394.069969:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025164032 00000100:00100000:0.0:1788658394.070015:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788658394.070025:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025164032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.070093:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025164032:12345-0@lo:400:kworker.0 Request processed in 69us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658394.070101:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788658394.070137:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025164288 00000100:00100000:0.0:1788658394.070141:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025164288 00000100:00100000:0.0:1788658394.070162:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025164544 00000100:00100000:0.0:1788658394.070166:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025164544 00000100:00100000:0.0:1788658394.070179:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788658394.070185:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025164288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.070385:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025164288:12345-0@lo:400:kworker.0 Request processed in 199us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658394.070392:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788658394.070405:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788658394.070411:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025164544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.070439:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025164544:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658394.070445:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788658394.070463:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025165056 00000100:00100000:0.0:1788658394.070466:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025165056 00000100:00100000:0.0:1788658394.070499:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025164928 00000100:00100000:0.0:1788658394.070502:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025164928 00000100:00100000:0.0:1788658394.070523:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788658394.070529:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025165056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.070564:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025165056:12345-0@lo:400:kworker.0 Request processed in 35us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658394.070571:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788658394.070582:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788658394.070735:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025164672 00000100:00100000:2.0:1788658394.070740:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025164672 00000100:00100000:2.0:1788658394.070754:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025165184 00000100:00100000:2.0:1788658394.070764:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025165184 00000100:00100000:2.0:1788658394.070782:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025164800 00000100:00100000:2.0:1788658394.070785:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025164800 00000100:00100000:2.0:1788658394.070798:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025165312 00000100:00100000:2.0:1788658394.070802:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025165312 00000100:00100000:2.0:1788658394.070813:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025164416 00000100:00100000:2.0:1788658394.070816:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025164416 00000100:00100000:2.0:1788658394.070827:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788658394.070832:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025164160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.070867:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025164160:12345-0@lo:400:kworker.0 Request processed in 35us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658394.070873:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788658394.070886:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788658394.070892:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025164672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.070919:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025164672:12345-0@lo:400:kworker.0 Request processed in 28us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658394.070925:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788658394.070936:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788658394.070942:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025165184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.070969:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025165184:12345-0@lo:400:kworker.0 Request processed in 28us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658394.070975:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788658394.070985:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788658394.070991:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025164800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.071019:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025164800:12345-0@lo:400:kworker.0 Request processed in 28us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658394.071025:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788658394.071046:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788658394.071052:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025165312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.071085:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025165312:12345-0@lo:400:kworker.0 Request processed in 34us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658394.071092:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788658394.071102:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788658394.071109:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025164416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658394.071134:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025164416:12345-0@lo:400:kworker.0 Request processed in 27us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658394.071141:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788658394.071246:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025164928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.071280:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025164928:12345-0@lo:400:kworker.0 Request processed in 38us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658394.071286:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788658394.071353:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025164288:0@lo:400:kworker.0 00010000:00080000:0.0:1788658394.071372:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d81b3bb80 x1875544025164800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658394.071383:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025164800:0@lo:400:kworker.0 00010000:00080000:0.0:1788658394.071397:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d81b38380 x1875544025165312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658394.071405:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025165312:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.071418:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025164160:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.071430:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025164672:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.071440:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025165184:0@lo:400:kworker.0 00000100:00080000:0.0:1788658394.071475:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658394.071480:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658394.071483:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658394.071504:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025164416:0@lo:400:kworker.0 00010000:00080000:0.0:1788658394.071514:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d81b39180 x1875544025164928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658394.071523:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025164928:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.071532:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025164032:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.071555:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025164544:0@lo:400:kworker.0 00010000:00080000:0.0:1788658394.071567:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d81b38000 x1875544025165056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658394.071575:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025165056:0@lo:400:kworker.0 00000100:00100000:0.0:1788658394.558946:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658394.558973:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025165440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658394.559060:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658394.559146:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025165440 00000100:00100000:0.0:1788658394.559154:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025165440 00000100:00100000:0.0:1788658394.559203:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788658394.559212:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025165440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658394.559243:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658394.559298:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025165440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658394.559305:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:1.0:1788658394.559311:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788658394.559349:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3b480 x1875544025165440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658394.559379:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025165440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658394.559403:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025165568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658394.559428:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658394.560008:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025165568 00000100:00100000:1.0:1788658394.560016:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025165568 00000100:00100000:1.0:1788658394.560084:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788658394.560095:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025165568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658394.560113:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658394.560175:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025165568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658394.560182:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788658394.560279:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83497b80 x1875544025165568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658394.560300:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025165568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658395.071080:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025165696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658395.071173:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658395.071306:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025165696 00000100:00100000:0.0:1788658395.071314:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025165696 00000100:00100000:0.0:1788658395.071374:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788658395.071384:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025165696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658395.071429:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788658395.071493:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025165696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658395.071501:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788658395.071762:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025165696:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788658395.584858:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658396.349422:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658396.349469:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658396.349496:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658396.349526:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658396.349546:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658396.349562:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658396.349584:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658396.349614:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000970496 00000100:00100000:2.0:1788658396.349624:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000970496 00000100:00100000:2.0:1788658396.349687:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000970752 00000100:00100000:2.0:1788658396.349690:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000970752 00000100:00100000:2.0:1788658396.349733:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000970624 00000100:00100000:2.0:1788658396.349737:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000970624 00000100:00100000:2.0:1788658396.349760:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000970880 00000100:00100000:2.0:1788658396.349763:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000970880 00000100:00100000:2.0:1788658396.349778:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:2.0:1788658396.349788:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000970496:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658396.349862:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000970496:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 75us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658396.349869:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:2.0:1788658396.349885:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 160 00000100:00100000:2.0:1788658396.349892:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000970752:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658396.349916:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000970752:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658396.349923:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 160 00000100:00100000:2.0:1788658396.349935:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 161 00000100:00100000:2.0:1788658396.349941:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000970624:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658396.349965:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000970624:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658396.349972:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 161 00000100:00100000:2.0:1788658396.349983:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 162 00000100:00100000:2.0:1788658396.349990:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000970880:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658396.350013:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000970880:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658396.350019:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 162 00000100:00100000:2.0:1788658396.350038:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000971008 00000100:00100000:2.0:1788658396.350042:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000971008 00000100:00100000:2.0:1788658396.350088:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000971136 00000100:00100000:2.0:1788658396.350092:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000971136 00000100:00100000:2.0:1788658396.350113:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:2.0:1788658396.350120:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000971008:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658396.350147:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000971008:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658396.350153:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:2.0:1788658396.350164:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:2.0:1788658396.350169:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000971136:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658396.350193:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000971136:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658396.350200:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:2.0:1788658396.350219:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000970368 00000100:00100000:2.0:1788658396.350223:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000970368 00000100:00100000:2.0:1788658396.350261:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 307 00000100:00100000:2.0:1788658396.350268:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000970368:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658396.350293:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000970368:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658396.350300:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 307 00000100:00080000:2.0:1788658396.350335:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658396.350340:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658396.350342:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658396.350344:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788658396.606888:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658397.631019:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658397.632005:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658397.632027:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025165824:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658397.632105:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658397.632177:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025165824 00000100:00100000:0.0:1788658397.632185:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025165824 00000100:00100000:0.0:1788658397.632232:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788658397.632241:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025165824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658397.632273:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788658397.632314:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025165824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658397.632321:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788658397.632363:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025165824:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788658398.654970:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658399.166932:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025166080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658399.167016:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658399.167066:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025166080 00000100:00100000:0.0:1788658399.167073:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025166080 00000100:00100000:3.0:1788658399.167096:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025165952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658399.167126:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788658399.167127:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658399.167138:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025166080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658399.167168:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658399.167210:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025166080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658399.167217:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788658399.167241:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025165952 00010000:00080000:3.0:1788658399.167242:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f0700 x1875544025166080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658399.167244:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025165952 00000100:00100000:0.0:1788658399.167259:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788658399.167264:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025166080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658399.167265:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025165952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658399.167281:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658399.167304:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025165952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658399.167308:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1788658399.167328:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb38380 x1875544025165952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658399.167341:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025165952:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788658399.167518:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658399.167601:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025166208:0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.167639:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658399.167651:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025166592:0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.167692:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025166720:0@lo:400:kworker.0 00000100:00100000:1.0:1788658399.167693:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025166464:0@lo:400:kworker.0 00000100:00100000:3.0:1788658399.167724:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658399.167752:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658399.167760:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025166208 00000100:00100000:2.0:1788658399.167765:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025166208 00000100:00100000:3.0:1788658399.167770:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025167104:0@lo:400:kworker.0 00000100:00100000:0.0:1788658399.167776:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025166336:0@lo:400:kworker.0 00000100:00100000:1.0:1788658399.167785:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025166976:0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.167797:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788658399.167806:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025166208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658399.167816:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658399.167819:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658399.167829:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025166464 00000100:00100000:1.0:1788658399.167834:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025166464 00000100:00100000:0.0:1788658399.167853:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025166848:0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.167861:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025166208:12345-0@lo:400:kworker.0 Request processed in 55us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658399.167868:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788658399.167868:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788658399.167878:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025166464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658399.167879:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658399.167900:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025167360:0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.167903:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025166592 00000100:00100000:2.0:1788658399.167908:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025166592 00000100:00100000:3.0:1788658399.167914:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025166336 00000100:00100000:3.0:1788658399.167920:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025166336 00000100:00100000:1.0:1788658399.167934:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025166464:12345-0@lo:400:kworker.0 Request processed in 57us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658399.167938:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025166848 00000100:00100000:0.0:1788658399.167942:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658399.167944:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025166848 00000100:00100000:1.0:1788658399.167944:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788658399.167955:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025167360 00000100:00100000:3.0:1788658399.167960:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025167360 00000100:00100000:2.0:1788658399.167979:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788658399.167989:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025166592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658399.167995:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788658399.168004:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025166336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.168039:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025166592:12345-0@lo:400:kworker.0 Request processed in 53us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658399.168047:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788658399.168051:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025166336:12345-0@lo:400:kworker.0 Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658399.168062:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788658399.168068:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788658399.168079:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025166848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658399.168084:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788658399.168087:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025166592:0@lo:400:kworker.0 00000100:00100000:3.0:1788658399.168096:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025167360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.168112:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025166848:12345-0@lo:400:kworker.0 Request processed in 35us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658399.168119:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788658399.168135:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025167360:12345-0@lo:400:kworker.0 Request processed in 42us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658399.168148:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025167104 00000100:00100000:3.0:1788658399.168153:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788658399.168154:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025167104 00000100:00100000:2.0:1788658399.168187:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788658399.168196:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025167104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.168240:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025167104:12345-0@lo:400:kworker.0 Request processed in 46us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658399.168253:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788658399.168273:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658399.168277:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658399.168286:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658399.168308:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025167232:0@lo:400:kworker.0 00000100:00100000:3.0:1788658399.168326:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025166720 00000100:00100000:3.0:1788658399.168331:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025166720 00000100:00100000:0.0:1788658399.168336:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658399.168338:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658399.168359:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788658399.168367:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025167488:0@lo:400:kworker.0 00000100:00100000:3.0:1788658399.168369:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025166720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.168375:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025166208:0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.168405:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025167232 00000100:00100000:0.0:1788658399.168408:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658399.168411:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025167232 00000100:00100000:3.0:1788658399.168422:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025166720:12345-0@lo:400:kworker.0 Request processed in 55us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658399.168430:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1788658399.168434:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cce00 x1875544025167104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658399.168446:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025167104:0@lo:400:kworker.0 00000100:00100000:0.0:1788658399.168449:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025166464:0@lo:400:kworker.0 00000100:00100000:0.0:1788658399.168477:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025166336:0@lo:400:kworker.0 00000100:00100000:0.0:1788658399.168488:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025166848:0@lo:400:kworker.0 00000100:00100000:0.0:1788658399.168497:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025167360:0@lo:400:kworker.0 00000100:00100000:0.0:1788658399.168516:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025166976 00000100:00100000:0.0:1788658399.168520:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025166976 00000100:00100000:0.0:1788658399.168551:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025167488 00000100:00100000:0.0:1788658399.168561:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025167488 00000100:00100000:0.0:1788658399.168595:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788658399.168602:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025166976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658399.168642:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025166976:12345-0@lo:400:kworker.0 Request processed in 41us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658399.168644:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658399.168654:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788658399.168658:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025167232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658399.168674:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788658399.168683:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025167488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658399.168699:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025167232:12345-0@lo:400:kworker.0 Request processed in 44us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658399.168728:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658399.168755:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025167488:12345-0@lo:400:kworker.0 Request processed in 72us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658399.168762:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1788658399.168764:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658399.168769:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788658399.168798:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cc380 x1875544025166976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658399.168803:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025166720:0@lo:400:kworker.0 00000100:00100000:0.0:1788658399.168817:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025166976:0@lo:400:kworker.0 00010000:00080000:2.0:1788658399.168822:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cf800 x1875544025167232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658399.168836:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025167232:0@lo:400:kworker.0 00010000:00080000:0.0:1788658399.168836:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837ce680 x1875544025167488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658399.168850:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025167488:0@lo:400:kworker.0 00000020:00000004:2.0:1788658399.325991:0:12521:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658399.326233:0:12521:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788658399.678884:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658399.679236:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025167616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658399.679311:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658399.679482:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025167616 00000100:00100000:0.0:1788658399.679490:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025167616 00000100:00100000:0.0:1788658399.679555:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788658399.679566:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025167616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658399.679596:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658399.679657:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025167616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658399.679663:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1788658399.679891:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c1c00 x1875544025167616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658399.679911:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025167616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658399.680456:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025167744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658399.680495:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658399.680581:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025167744 00000100:00100000:1.0:1788658399.680586:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025167744 00000100:00100000:1.0:1788658399.680631:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788658399.680639:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025167744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658399.680654:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658399.680732:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025167744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658399.680740:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788658399.680921:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cdf80 x1875544025167744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658399.680936:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025167744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658400.190989:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658400.191017:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025167872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658400.191097:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658400.191170:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025167872 00000100:00100000:0.0:1788658400.191178:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025167872 00000100:00100000:0.0:1788658400.191226:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788658400.191235:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025167872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658400.191269:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788658400.191313:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025167872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658400.191320:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788658400.191363:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025167872:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788658400.712048:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658401.470523:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658401.470572:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658401.470607:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658401.470631:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658401.470665:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000971392 00000100:00100000:1.0:1788658401.470674:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000971392 00000100:00100000:1.0:1788658401.470773:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000971520 00000100:00100000:1.0:1788658401.470778:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000971520 00000100:00100000:1.0:1788658401.470799:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000971776 00000100:00100000:1.0:1788658401.470802:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000971776 00000100:00100000:1.0:1788658401.470820:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 169 00000100:00100000:1.0:1788658401.470829:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544000971392:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658401.470902:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544000971392:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 73us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658401.470910:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 169 00000100:00100000:1.0:1788658401.470927:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 170 00000100:00100000:1.0:1788658401.470933:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000971520:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658401.470972:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000971520:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 39us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658401.470978:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 170 00000100:00100000:1.0:1788658401.470990:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 171 00000100:00100000:1.0:1788658401.470997:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000971776:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658401.471018:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000971776:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658401.471024:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 171 00000100:00080000:1.0:1788658401.471041:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658401.471045:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658401.471503:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000971264 00000100:00100000:3.0:1788658401.471510:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000971264 00000100:00100000:3.0:1788658401.471557:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 309 00000100:00100000:3.0:1788658401.471566:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000971264:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658401.471605:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000971264:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 39us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658401.471612:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 309 00000100:00100000:1.0:1788658401.496886:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658401.496924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658401.496963:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658401.496994:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000971648 00000100:00100000:1.0:1788658401.497004:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000971648 00000100:00100000:1.0:1788658401.497066:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 172 00000100:00100000:1.0:1788658401.497076:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544000971648:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658401.497148:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544000971648:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658401.497155:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 172 00000100:00080000:1.0:1788658401.497179:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658401.497341:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000971904 00000100:00100000:2.0:1788658401.497357:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000971904 00000100:00100000:2.0:1788658401.497406:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000972032 00000100:00100000:2.0:1788658401.497409:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000972032 00000100:00100000:2.0:1788658401.497428:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:2.0:1788658401.497435:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2395:x1875544000971904:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:2.0:1788658401.497455:0:10365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e9cd 00000100:00080000:2.0:1788658401.497465:0:10365:0:(import.c:65:import_set_state_nolock()) ffff8a1eb5e65000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658401.497529:0:10365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788658401.497658:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+2:2395:x1875544000971904:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 222us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658401.497665:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:2.0:1788658401.497678:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:2.0:1788658401.497685:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2395:x1875544000972032:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:2.0:1788658401.497697:0:10365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e9c6 00000100:00080000:2.0:1788658401.497728:0:10365:0:(import.c:65:import_set_state_nolock()) ffff8a1d835f3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658401.497751:0:10365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788658401.497822:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+2:2395:x1875544000972032:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 138us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658401.497830:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00080000:1.0:1788658401.498097:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658401.498101:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788658401.499339:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658401.504017:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658401.729639:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788658402.062191:0:12618:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658402.062460:0:12618:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788658402.754778:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658402.755573:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658402.755596:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025168000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658402.755736:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658402.755968:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025168000 00000100:00100000:3.0:1788658402.755977:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025168000 00000100:00100000:3.0:1788658402.756037:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788658402.756048:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025168000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658402.756085:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658402.756139:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025168000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658402.756147:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788658402.756190:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025168000:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788658403.799429:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658404.287236:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025168128:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287317:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287367:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025168640:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287396:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287415:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025169152:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287468:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287486:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025169664:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287503:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287533:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788658404.287538:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025168256:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287559:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287573:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025168768:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287595:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287611:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025169280:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287630:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287660:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025168384:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287683:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287728:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025168896:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287750:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287766:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025169408:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287784:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287799:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788658404.287804:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025168512:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287823:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287834:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025169024:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287854:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287870:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025169536:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.287888:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658404.287917:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025168128 00000100:00100000:2.0:1788658404.287930:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025168128 00000100:00100000:2.0:1788658404.287977:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788658404.287986:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025168128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.288033:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025168128:12345-0@lo:400:kworker.0 Request processed in 48us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.288040:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788658404.288073:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025169152 00000100:00100000:2.0:1788658404.288076:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025169152 00000100:00100000:2.0:1788658404.288102:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025169664 00000100:00100000:2.0:1788658404.288105:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025169664 00000100:00100000:2.0:1788658404.288117:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025169024 00000100:00100000:2.0:1788658404.288120:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025169024 00000100:00100000:2.0:1788658404.288131:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025169536 00000100:00100000:2.0:1788658404.288133:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025169536 00000100:00100000:2.0:1788658404.288147:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788658404.288153:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025169152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.288197:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025169152:12345-0@lo:400:kworker.0 Request processed in 44us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.288203:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788658404.288215:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788658404.288220:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025169664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.288247:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025169664:12345-0@lo:400:kworker.0 Request processed in 27us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.288253:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788658404.288263:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788658404.288267:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025169024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.288298:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025169024:12345-0@lo:400:kworker.0 Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.288312:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788658404.288324:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788658404.288329:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025169536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.288356:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025169536:12345-0@lo:400:kworker.0 Request processed in 27us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.288362:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788658404.288382:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025168256 00000100:00100000:2.0:1788658404.288385:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025168256 00000100:00100000:2.0:1788658404.288401:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025168768 00000100:00100000:2.0:1788658404.288403:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025168768 00000100:00100000:2.0:1788658404.288414:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025169280 00000100:00100000:2.0:1788658404.288417:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025169280 00000100:00100000:2.0:1788658404.288433:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025168896 00000100:00100000:2.0:1788658404.288438:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025168896 00000100:00100000:2.0:1788658404.288448:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025169408 00000100:00100000:2.0:1788658404.288450:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025169408 00000100:00100000:2.0:1788658404.288459:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025168512 00000100:00100000:2.0:1788658404.288462:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025168512 00000100:00100000:2.0:1788658404.288472:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788658404.288478:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025168256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.288510:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025168256:12345-0@lo:400:kworker.0 Request processed in 31us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.288516:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788658404.288527:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788658404.288532:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025168768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.288556:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025168768:12345-0@lo:400:kworker.0 Request processed in 24us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.288562:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788658404.288581:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788658404.288587:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025169280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.288615:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025169280:12345-0@lo:400:kworker.0 Request processed in 29us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.288621:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788658404.288633:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788658404.288638:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025168896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.288664:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025168896:12345-0@lo:400:kworker.0 Request processed in 25us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.288670:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788658404.288680:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788658404.288686:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025169408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658404.294833:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025168640 00000100:00100000:1.0:1788658404.294865:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025168640 00000100:00100000:1.0:1788658404.294917:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025168384 00000100:00100000:1.0:1788658404.294921:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025168384 00000100:00100000:1.0:1788658404.294939:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788658404.294947:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025168640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658404.295032:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025168640:12345-0@lo:400:kworker.0 Request processed in 86us (7635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658404.295038:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788658404.295053:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788658404.295057:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025168384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658404.295082:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025168384:12345-0@lo:400:kworker.0 Request processed in 25us (7398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658404.295087:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788658404.295103:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788658404.295111:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025168512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658404.295140:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025168512:12345-0@lo:400:kworker.0 Request processed in 30us (7316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658404.295145:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1788658404.295187:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658404.295192:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658404.295196:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658404.295198:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658404.295353:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025169408:12345-0@lo:400:kworker.0 Request processed in 6666us (7566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.295361:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788658404.295424:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025168512:0@lo:400:kworker.0 00010000:00080000:2.0:1788658404.295454:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83497b80 x1875544025169024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658404.295466:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025169024:0@lo:400:kworker.0 00010000:00080000:2.0:1788658404.295480:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275ed80 x1875544025169536/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658404.295488:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025169536:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.295498:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025168384:0@lo:400:kworker.0 00010000:00080000:2.0:1788658404.295540:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834f0700 x1875544025168896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658404.295548:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025168896:0@lo:400:kworker.0 00010000:00080000:2.0:1788658404.295558:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275f480 x1875544025169408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658404.295566:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025169408:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.295617:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025168256:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.295628:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025168768:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.295640:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025169280:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.295651:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025168128:0@lo:400:kworker.0 00000100:00100000:2.0:1788658404.295661:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025168640:0@lo:400:kworker.0 00010000:00080000:2.0:1788658404.295673:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83497100 x1875544025169152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658404.295681:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025169152:0@lo:400:kworker.0 00010000:00080000:2.0:1788658404.295694:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8275ea00 x1875544025169664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658404.295735:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025169664:0@lo:400:kworker.0 00000100:00100000:1.0:1788658404.299338:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025169792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658404.299423:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658404.299484:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025169792 00000100:00100000:1.0:1788658404.299491:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025169792 00000100:00100000:1.0:1788658404.299545:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788658404.299554:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025169792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658404.299597:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658404.299618:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658404.299627:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025169920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658404.299654:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025169792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658404.299659:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658404.299667:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788658404.299686:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025169920 00000100:00100000:1.0:1788658404.299690:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025169920 00000100:00100000:1.0:1788658404.299721:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788658404.299732:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025169920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658404.299744:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658404.299769:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025169920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658404.299776:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788658404.299809:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebd9c8e00 x1875544025169920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788658404.299814:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cc000 x1875544025169792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658404.299828:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025169920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658404.299833:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025169792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788658404.799492:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658404.799602:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658404.799622:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025170176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658404.799741:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658404.799802:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025170176 00000100:00100000:0.0:1788658404.799809:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025170176 00000100:00100000:0.0:1788658404.799856:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788658404.799865:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025170176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658404.799893:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658404.799939:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025170176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658404.799945:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788658404.800000:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e840c0380 x1875544025170176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658404.800019:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025170176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658404.800373:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025170048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658404.800417:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658404.801621:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025170048 00000100:00100000:0.0:1788658404.801631:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025170048 00000100:00100000:0.0:1788658404.801687:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788658404.801696:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025170048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658404.801748:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658404.801813:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025170048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658404.801819:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1788658404.801926:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eadba2680 x1875544025170048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658404.801946:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025170048:0@lo:13:osp-pre-0-0.0 00000020:00000004:1.0:1788658405.168649:0:12716:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658405.169004:0:12716:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788658405.320457:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025170304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658405.320550:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658405.320634:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025170304 00000100:00100000:3.0:1788658405.320642:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025170304 00000100:00100000:3.0:1788658405.320689:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788658405.320698:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025170304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658405.320745:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788658405.320827:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025170304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658405.320834:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788658405.321552:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025170304:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658405.824219:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658406.586689:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658406.586751:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658406.586774:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658406.586807:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000972416 00000100:00100000:0.0:1788658406.586819:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000972416 00000100:00080000:1.0:1788658406.586860:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658406.586881:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000972672 00000100:00100000:1.0:1788658406.586885:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000972672 00000100:00100000:0.0:1788658406.586888:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 179 00000100:00100000:0.0:1788658406.586918:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000972416:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658406.586930:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 180 00000100:00100000:1.0:1788658406.586938:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000972672:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658406.586983:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000972672:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 48us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658406.587000:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 180 00000100:00100000:2.0:1788658406.587014:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000972160 00000100:00100000:2.0:1788658406.587019:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000972160 00000100:00100000:2.0:1788658406.587676:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 311 00000100:00100000:2.0:1788658406.587690:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544000972160:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658406.590241:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000972416:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 3331us (3475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658406.590258:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 179 00000100:00100000:2.0:1788658406.590340:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544000972160:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 2650us (3654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658406.590351:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 311 00000100:00080000:0.0:1788658406.590368:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658406.590613:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658406.590772:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000972288 00000100:00100000:2.0:1788658406.590781:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000972288 00000100:00100000:2.0:1788658406.590869:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:2.0:1788658406.590880:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544000972288:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658406.590897:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658406.590949:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544000972288:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 70us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658406.590957:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:2.0:1788658406.590969:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000972544 00000100:00100000:2.0:1788658406.590973:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000972544 00000100:00080000:1.0:1788658406.591027:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658406.591051:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00100000:3.0:1788658406.591103:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000972544:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658406.591143:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000972544:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 43us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658406.591288:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 182 00010000:00010000:2.0:1788658406.847044:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788658407.607893:0:12813:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658407.608370:0:12813:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788658407.883406:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658407.886777:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025170432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658407.886872:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658407.886976:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025170432 00000100:00100000:0.0:1788658407.886985:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025170432 00000100:00100000:0.0:1788658407.887084:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788658407.887105:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025170432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658407.887150:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788658407.887220:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025170432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658407.887228:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788658407.887334:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025170432:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788658407.887888:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bab2558f-23d6-4f42-bb42-9568fb514d36 00000020:00000080:0.0:1788658407.887895:0:9530:0:(genops.c:885:class_export_put()) final put ffff8a1d835f2000/bab2558f-23d6-4f42-bb42-9568fb514d36 00000020:00000080:2.0:1788658407.891794:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d835f2000/bab2558f-23d6-4f42-bb42-9568fb514d36 for lustre-OST0001 00000020:00000080:2.0:1788658407.891858:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d835f3000 for lustre-OST0001 00000001:00100000:0.0:1788658407.899194:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bab2558f-23d6-4f42-bb42-9568fb514d36 00000020:00000080:0.0:1788658407.899208:0:8447:0:(genops.c:885:class_export_put()) final put ffff8a1eb5e64000/bab2558f-23d6-4f42-bb42-9568fb514d36 00000020:00000080:1.0:1788658407.910218:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb5e64000/bab2558f-23d6-4f42-bb42-9568fb514d36 for lustre-OST0000 00000020:00000080:1.0:1788658407.910336:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb5e65000 for lustre-OST0000 00010000:00010000:3.0:1788658408.898231:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658409.407777:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025170560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658409.407892:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658409.408011:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025170560 00000100:00100000:2.0:1788658409.408021:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025170560 00000100:00100000:2.0:1788658409.408081:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788658409.408092:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025170560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658409.408131:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658409.408178:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025170560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658409.408185:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788658409.408210:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025170688:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658409.408237:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788658409.408268:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658409.408279:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025170688 00000100:00100000:2.0:1788658409.408283:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025170688 00000100:00100000:2.0:1788658409.408304:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788658409.408309:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025170688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658409.408321:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658409.408350:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025170688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658409.408356:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788658409.408391:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cc380 x1875544025170560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658409.408413:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025170560:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788658409.408662:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788658409.408679:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebd9c9500 x1875544025170688/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658409.408728:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025170688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658409.409755:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025170944:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.409816:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658409.409857:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025171456:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.409880:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658409.409902:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025171968:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.409923:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658409.409949:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788658409.409954:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025171072:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.409984:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658409.410002:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025171584:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410022:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658409.410037:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025172096:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410056:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658409.410090:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025170944 00000100:00100000:1.0:1788658409.410097:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025170944 00000100:00100000:1.0:1788658409.410134:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025171456 00000100:00100000:1.0:1788658409.410137:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025171456 00000100:00100000:1.0:1788658409.410155:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025171968 00000100:00100000:1.0:1788658409.410158:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025171968 00000100:00100000:1.0:1788658409.410171:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025171584 00000100:00100000:1.0:1788658409.410173:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025171584 00000100:00100000:1.0:1788658409.410193:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025172096 00000100:00100000:1.0:1788658409.410195:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025172096 00000100:00100000:1.0:1788658409.410208:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788658409.410216:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025170944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410270:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025170944:12345-0@lo:400:kworker.0 Request processed in 54us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658409.410276:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788658409.410291:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788658409.410296:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025171456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410323:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025171456:12345-0@lo:400:kworker.0 Request processed in 27us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658409.410329:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788658409.410337:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788658409.410343:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025171968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410365:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025171968:12345-0@lo:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658409.410371:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788658409.410382:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788658409.410387:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025171584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410411:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025171584:12345-0@lo:400:kworker.0 Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658409.410417:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788658409.410573:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788658409.410580:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025172096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410620:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025172096:12345-0@lo:400:kworker.0 Request processed in 41us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658409.410632:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788658409.410653:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025171072 00000100:00100000:1.0:1788658409.410658:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025171072 00000100:00100000:1.0:1788658409.410691:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788658409.410698:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025171072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410761:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025171072:12345-0@lo:400:kworker.0 Request processed in 63us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658409.410767:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788658409.410826:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025171072:0@lo:400:kworker.0 00010000:00080000:1.0:1788658409.410840:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83670e00 x1875544025171584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658409.410850:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025171584:0@lo:400:kworker.0 00010000:00080000:1.0:1788658409.410861:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83673b80 x1875544025172096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658409.410869:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025172096:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410879:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025170944:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410889:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025171456:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.410897:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025171968:0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411021:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025170816:0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411063:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658409.411092:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025171328:0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411115:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658409.411139:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025171840:0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411164:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658409.411184:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788658409.411190:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025171200:0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411213:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658409.411229:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025171712:0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411250:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658409.411284:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025171200 00000100:00100000:2.0:1788658409.411287:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025171200 00000100:00100000:2.0:1788658409.411317:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788658409.411324:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025171200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411358:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025171200:12345-0@lo:400:kworker.0 Request processed in 35us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658409.411365:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:2.0:1788658409.411382:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658409.411387:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658409.411397:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025170816 00000100:00100000:2.0:1788658409.411400:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025170816 00000100:00100000:2.0:1788658409.411437:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788658409.411445:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025170816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411485:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025170816:12345-0@lo:400:kworker.0 Request processed in 41us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658409.411491:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788658409.411521:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025171840 00000100:00100000:2.0:1788658409.411524:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025171840 00000100:00100000:2.0:1788658409.411554:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025171712 00000100:00100000:2.0:1788658409.411558:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025171712 00000100:00100000:2.0:1788658409.411577:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788658409.411583:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025171840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411624:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025171840:12345-0@lo:400:kworker.0 Request processed in 41us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658409.411630:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788658409.411640:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788658409.411646:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025171712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411674:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025171712:12345-0@lo:400:kworker.0 Request processed in 28us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658409.411679:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788658409.411737:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025171200:0@lo:400:kworker.0 00010000:00080000:2.0:1788658409.411750:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83673800 x1875544025171712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658409.411760:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025171712:0@lo:400:kworker.0 00000100:00100000:2.0:1788658409.411767:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025170816:0@lo:400:kworker.0 00010000:00080000:2.0:1788658409.411775:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83670700 x1875544025171840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658409.411794:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025171840:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.412128:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025171328 00000100:00100000:1.0:1788658409.412133:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025171328 00000100:00100000:1.0:1788658409.412160:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788658409.412167:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025171328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.412215:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025171328:12345-0@lo:400:kworker.0 Request processed in 49us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658409.412222:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1788658409.412264:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658409.412294:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025171328:0@lo:400:kworker.0 00000100:00100000:1.0:1788658409.923636:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658409.923659:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025172224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658409.925975:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658409.926262:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025172224 00000100:00100000:1.0:1788658409.926271:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025172224 00000100:00100000:1.0:1788658409.926357:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788658409.926366:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025172224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658409.926401:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658409.926451:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025172224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658409.926460:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1788658409.928014:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658409.928374:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658409.928401:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025172352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658409.928473:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658409.929808:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025172352 00000100:00100000:3.0:1788658409.929825:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025172352 00000100:00100000:3.0:1788658409.929869:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788658409.929877:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025172352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658409.929911:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658409.929985:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025172352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658409.929992:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788658409.930037:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eadba2680 x1875544025172352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658409.930057:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025172352:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788658409.936438:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83672680 x1875544025172224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658409.936469:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025172224:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788658409.983579:0:12911:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658409.984060:0:12911:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788658410.430995:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025172480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658410.431071:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658410.431926:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025172480 00000100:00100000:3.0:1788658410.431935:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025172480 00000100:00100000:3.0:1788658410.431979:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788658410.431986:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025172480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658410.432015:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788658410.432078:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025172480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658410.432083:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788658410.432945:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025172480:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658410.949266:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658411.709160:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658411.709192:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658411.709227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658411.709261:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658411.709284:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658411.709309:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000972800 00000100:00100000:2.0:1788658411.709319:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000972800 00000100:00100000:2.0:1788658411.709394:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 313 00000100:00100000:2.0:1788658411.709404:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544000972800:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658411.709472:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544000972800:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658411.709480:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 313 00000100:00100000:2.0:1788658411.709513:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000972928 00000100:00100000:2.0:1788658411.709517:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000972928 00000100:00100000:2.0:1788658411.709550:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000973184 00000100:00100000:2.0:1788658411.709553:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000973184 00000100:00100000:2.0:1788658411.709566:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000973056 00000100:00100000:2.0:1788658411.709569:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000973056 00000100:00100000:2.0:1788658411.709580:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000973312 00000100:00100000:2.0:1788658411.709582:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000973312 00000100:00100000:2.0:1788658411.709595:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 189 00000100:00100000:2.0:1788658411.709601:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544000972928:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658411.709837:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 190 00000100:00100000:3.0:1788658411.709848:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000973184:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658411.709878:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000973184:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 33us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658411.709885:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 190 00000100:00100000:3.0:1788658411.709898:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 191 00000100:00100000:3.0:1788658411.709904:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000973056:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658411.709926:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000973056:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658411.709933:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 191 00000100:00100000:3.0:1788658411.709945:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:3.0:1788658411.709950:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000973312:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658411.709974:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000973312:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658411.709980:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:2.0:1788658411.710191:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544000972928:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 589us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658411.710211:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 189 00000100:00080000:2.0:1788658411.711938:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658411.711947:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788658411.970667:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658412.990818:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658412.991086:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025172608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658412.991162:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658412.991730:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025172608 00000100:00100000:0.0:1788658412.991739:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025172608 00000100:00100000:0.0:1788658412.991790:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788658412.991799:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025172608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658412.991835:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788658412.991896:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025172608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658412.991903:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788658412.992025:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025172608:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788658414.015873:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788658414.320360:0:13055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788658414.533646:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025172992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658414.533770:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658414.533841:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658414.533849:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025172864:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658414.533875:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658414.533907:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025172992 00000100:00100000:1.0:1788658414.533915:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025172992 00000100:00100000:1.0:1788658414.533972:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025172864 00000100:00100000:1.0:1788658414.533989:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025172864 00000100:00100000:1.0:1788658414.534262:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788658414.534278:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025172992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658414.534319:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1788658414.534523:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83670e00 x1875544025172992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658414.534563:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025172992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658414.534803:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025172992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 389us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658414.534814:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788658414.534842:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788658414.534850:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025172864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658414.534862:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658414.534899:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025172864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658414.534904:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788658414.534927:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788658414.534999:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83672680 x1875544025172864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658414.535029:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025172864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658414.535211:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658414.535226:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025172736:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.535271:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658414.535316:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025172736 00000100:00100000:2.0:1788658414.535321:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025172736 00000100:00100000:2.0:1788658414.535357:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788658414.535365:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e88550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025172736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.536249:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e88550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025172736:12345-0@lo:400:kworker.0 Request processed in 879us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658414.536261:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788658414.536323:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025172736:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.538153:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025173120:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.538242:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658414.538371:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025173248:0@lo:400:kworker.0 00000100:00100000:0.0:1788658414.538894:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025173120 00000100:00100000:0.0:1788658414.538904:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025173120 00000100:00100000:0.0:1788658414.538967:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788658414.538978:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025173120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658414.539062:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025173120:12345-0@lo:400:kworker.0 Request processed in 85us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658414.539070:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788658414.540333:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658414.542245:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025173248 00000100:00100000:0.0:1788658414.542265:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025173248 00000100:00100000:0.0:1788658414.542356:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788658414.542369:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025173248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658414.542487:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025173248:12345-0@lo:400:kworker.0 Request processed in 121us (2155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658414.542495:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788658414.542829:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025173120:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.542878:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025173248:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.542967:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658414.542979:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025173376:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.544923:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658414.545228:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025173376 00000100:00100000:0.0:1788658414.545240:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025173376 00000100:00100000:2.0:1788658414.545367:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658414.545400:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025173504:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.545463:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658414.545498:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025173504 00000100:00100000:2.0:1788658414.545502:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025173504 00000100:00100000:2.0:1788658414.545536:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788658414.545546:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025173504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.545619:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025173504:12345-0@lo:400:kworker.0 Request processed in 73us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658414.545627:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788658414.545681:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025173504:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.545749:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025173632:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.545776:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658414.559883:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658414.559913:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025173760:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.560509:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025174144:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.560550:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658414.563644:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025173632 00000100:00100000:0.0:1788658414.563665:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025173632 00000100:00100000:0.0:1788658414.563792:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788658414.563808:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025173376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658414.563922:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025173376:12345-0@lo:400:kworker.0 Request processed in 120us (19010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658414.563947:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788658414.563971:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788658414.563977:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025173632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658414.564008:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025173632:12345-0@lo:400:kworker.0 Request processed in 31us (18231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658414.564031:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788658414.566441:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025174016:0@lo:400:kworker.0 00000100:00100000:0.0:1788658414.566565:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788658414.566657:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658414.571806:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025174272:0@lo:400:kworker.0 00000100:00100000:3.0:1788658414.573119:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025174144 00000100:00100000:3.0:1788658414.573137:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025174144 00000100:00100000:3.0:1788658414.573226:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788658414.573238:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025174144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658414.577734:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658414.577873:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025173888:0@lo:400:kworker.0 00000100:00100000:0.0:1788658414.577956:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658414.580493:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025173760 00000100:00100000:0.0:1788658414.580513:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025173760 00000100:00100000:0.0:1788658414.580680:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788658414.580695:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025173760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658414.580835:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025173760:12345-0@lo:400:kworker.0 Request processed in 145us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658414.580843:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:0.0:1788658414.580926:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eadba2680 x1875544025173760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658414.580962:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025173760:0@lo:400:kworker.0 00000100:00100000:3.0:1788658414.582339:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025174144:12345-0@lo:400:kworker.0 Request processed in 9093us (21778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658414.582354:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1788658414.582406:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658414.582413:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658414.582790:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025174016 00000100:00100000:3.0:1788658414.582801:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025174016 00000100:00100000:3.0:1788658414.582861:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025173888 00000100:00100000:3.0:1788658414.582865:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025173888 00000100:00100000:3.0:1788658414.582890:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788658414.582899:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025174016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658414.582967:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025174016:12345-0@lo:400:kworker.0 Request processed in 69us (16414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658414.582974:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788658414.582987:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788658414.582993:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025173888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658414.583045:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025173888:12345-0@lo:400:kworker.0 Request processed in 52us (5088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658414.583051:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788658414.583128:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658414.583207:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025173376:0@lo:400:kworker.0 00000100:00100000:3.0:1788658414.583246:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025174272 00000100:00100000:3.0:1788658414.583250:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025174272 00000100:00100000:3.0:1788658414.583291:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788658414.583298:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025174272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658414.583338:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025174272:12345-0@lo:400:kworker.0 Request processed in 40us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658414.583344:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:3.0:1788658414.583385:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eea680 x1875544025174272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658414.583397:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025174272:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.584179:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025174144:0@lo:400:kworker.0 00000100:00100000:2.0:1788658414.584197:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025173632:0@lo:400:kworker.0 00010000:00080000:0.0:1788658414.585843:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eeb480 x1875544025174016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658414.585865:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025174016:0@lo:400:kworker.0 00000100:00080000:0.0:1788658414.585927:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658414.585935:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788658414.585961:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ee8000 x1875544025173888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658414.585972:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025173888:0@lo:400:kworker.0 00000100:00100000:0.0:1788658415.039004:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025174400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658415.039107:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658415.039288:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658415.039477:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658415.039501:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025174528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658415.039579:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658415.039738:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025174400 00000100:00100000:1.0:1788658415.039749:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025174400 00000100:00100000:1.0:1788658415.039798:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025174528 00000100:00100000:1.0:1788658415.039801:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025174528 00000100:00100000:1.0:1788658415.039816:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788658415.039826:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025174400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658415.039864:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658415.039938:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025174400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658415.039946:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788658415.039974:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788658415.039981:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025174528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658415.039995:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658415.040051:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025174528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658415.040059:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788658415.040148:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83673100 x1875544025174400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658415.040173:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025174400:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788658415.040821:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e9836a680 x1875544025174528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658415.040845:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025174528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658415.552049:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658415.552093:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025174656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658415.552182:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658415.552258:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025174656 00000100:00100000:0.0:1788658415.552265:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025174656 00000100:00100000:0.0:1788658415.553130:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788658415.553150:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025174656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658415.553205:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788658415.553304:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025174656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658415.553313:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788658415.553464:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025174656:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788658416.071552:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658416.830277:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658416.830362:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658416.830431:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658416.830516:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000973568 00000100:00100000:0.0:1788658416.830529:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658416.830540:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000973568 00000100:00100000:0.0:1788658416.830605:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658416.830639:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000973824 00000100:00100000:2.0:1788658416.830644:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000973824 00000100:00100000:2.0:1788658416.830683:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000973696 00000100:00100000:2.0:1788658416.830687:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000973696 00000100:00100000:2.0:1788658416.830726:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000973952 00000100:00100000:2.0:1788658416.830729:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000973952 00000100:00100000:2.0:1788658416.830755:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 199 00000100:00100000:2.0:1788658416.830778:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000973568:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658416.830895:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000973568:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 129us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658416.830905:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 199 00000100:00100000:2.0:1788658416.830927:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:2.0:1788658416.830933:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000973824:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658416.830958:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000973824:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658416.830964:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:2.0:1788658416.830978:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 201 00000100:00100000:2.0:1788658416.830984:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000973696:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658416.831009:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000973696:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658416.831015:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 201 00000100:00100000:2.0:1788658416.831028:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:2.0:1788658416.831037:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000973952:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658416.831061:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000973952:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658416.831067:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:2.0:1788658416.831088:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000973440 00000100:00100000:2.0:1788658416.831223:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000973440 00000100:00100000:2.0:1788658416.831259:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 315 00000100:00100000:2.0:1788658416.831267:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000973440:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658416.831320:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000973440:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 54us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658416.831328:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 315 00000100:00080000:2.0:1788658416.831360:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658416.831364:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788658417.089962:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658418.111156:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025174784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658418.111260:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658418.112081:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025174784 00000100:00100000:1.0:1788658418.112096:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025174784 00000100:00100000:1.0:1788658418.112172:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788658418.112185:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025174784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658418.112235:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788658418.112313:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025174784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658418.112321:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788658418.112632:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025174784:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788658418.113283:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788658418.788509:0:13203:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8ac25440 20000000:00000080:0.0:1788658418.788535:0:13203:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1eb5e58400 uarg=0000000000000000 20000000:01000000:0.0:1788658418.788597:0:13203:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788658418.788604:0:13203:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788658418.788611:0:13203:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788658418.792124:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788658418.792393:0:13203:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788658418.811138:0:13203:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788658418.811315:0:13203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811346:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6e964 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc63e expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811357:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6e972 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e96b expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811364:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e980 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e979 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811371:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3390e00/0x48e67cc629c6e98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e987 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811379:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb23b2600/0x48e67cc629c6e99c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e995 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811387:0:13203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e9b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc67d expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811395:0:13203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811470:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc67d expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811489:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc67d expref: 12 pid: 6531 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.811507:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025174912:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658418.811687:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb23b2600/0x48e67cc629c6e99c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e995 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811697:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb23b2600/0x48e67cc629c6e99c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e995 expref: 23 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.811734:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025175040:0@lo:104: 00000100:00100000:2.0:1788658418.811787:0:13203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658418.811847:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3390e00/0x48e67cc629c6e98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e987 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811856:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb3390e00/0x48e67cc629c6e98e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e987 expref: 23 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.811865:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025175168:0@lo:104: 00000100:00100000:2.0:1788658418.811889:0:13203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658418.811913:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e980 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e979 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811922:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e980 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e979 expref: 23 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.811945:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025175296:0@lo:104: 00000100:00100000:2.0:1788658418.811969:0:13203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658418.811988:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6e972 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e96b expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.811996:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6e972 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e96b expref: 23 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.812004:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025175424:0@lo:104: 00000100:00100000:2.0:1788658418.812025:0:13203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658418.812043:0:13203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6e964 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc63e expref: 12 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.812051:0:13203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6e964 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc63e expref: 12 pid: 6530 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.812061:0:13203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025175552:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658418.812089:0:13203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8362aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658418.813012:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025175040 00000100:00100000:0.0:1788658418.813028:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025175040 00000100:00100000:0.0:1788658418.813084:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025175168 00000100:00100000:0.0:1788658418.813087:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025175168 00000100:00100000:0.0:1788658418.813099:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025175296 00000100:00100000:0.0:1788658418.813101:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025175296 00000100:00100000:0.0:1788658418.813112:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025175424 00000100:00100000:0.0:1788658418.813114:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025175424 00000100:00100000:0.0:1788658418.813131:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788658418.813142:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:13203:x1875544025175040:12345-0@lo:104: 00010000:00010000:0.0:1788658418.813160:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.813266:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658418.813274:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:13203:x1875544025175040:12345-0@lo:104: Request processed in 134us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658418.813281:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788658418.813306:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788658418.813313:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:13203:x1875544025175168:12345-0@lo:104: 00010000:00010000:0.0:1788658418.813322:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.813370:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788658418.813376:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:13203:x1875544025175168:12345-0@lo:104: Request processed in 64us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658418.813382:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788658418.813395:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788658418.813401:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:13203:x1875544025175296:12345-0@lo:104: 00010000:00010000:0.0:1788658418.813409:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.813440:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788658418.813444:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:13203:x1875544025175296:12345-0@lo:104: Request processed in 44us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658418.813450:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788658418.813461:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658418.813466:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:13203:x1875544025175424:12345-0@lo:104: 00010000:00010000:0.0:1788658418.813473:0:6519:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.813496:0:6519:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788658418.813501:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:13203:x1875544025175424:12345-0@lo:104: Request processed in 35us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658418.813507:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788658418.813638:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788658418.813645:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.813663:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658418.813668:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.813676:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658418.813683:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658418.813689:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788658418.813755:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.813762:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658418.813785:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.813792:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390400/0x48e67cc629c6e995 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e99c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.813806:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788658418.813810:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.813815:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658418.813817:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814120:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658418.814128:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814135:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391c00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658418.814146:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814153:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658418.814160:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658418.814167:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658418.814186:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814193:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658418.814216:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814223:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6e979 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e980 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814235:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658418.814238:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814243:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658418.814246:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814252:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658418.814269:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658418.814275:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658418.814288:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814294:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658418.814300:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814307:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6e96b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e972 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814318:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658418.814319:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658418.814321:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658418.814331:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658418.814349:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025175680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658418.814402:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658418.814443:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025175808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658418.814468:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658418.814488:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658418.814493:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025175936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658418.814512:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658418.814563:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025175680 00000100:00100000:3.0:1788658418.814570:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025175680 00010000:00010000:3.0:1788658418.814600:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb23b2600/0x48e67cc629c6e99c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e995 expref: 24 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658418.814634:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025175808 00000100:00100000:3.0:1788658418.814637:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025175808 00010000:00010000:3.0:1788658418.814653:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e980 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e979 expref: 25 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658418.814663:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025175936 00000100:00100000:3.0:1788658418.814665:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025175936 00010000:00010000:3.0:1788658418.814675:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6e972 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e96b expref: 26 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658418.814690:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788658418.814698:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+26:3647:x1875544025175680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658418.814738:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658418.814744:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb23b2600/0x48e67cc629c6e99c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e995 expref: 26 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814756:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb23b2600/0x48e67cc629c6e99c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e995 expref: 26 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814778:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658418.814810:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+26:3647:x1875544025175680:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658418.814818:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788658418.814844:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788658418.814850:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+25:3649:x1875544025175808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658418.814859:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658418.814864:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e980 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e979 expref: 25 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814884:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e980 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e979 expref: 25 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814894:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658418.814921:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+25:3649:x1875544025175808:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658418.814929:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788658418.814944:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788658418.814951:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025175936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658418.814961:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658418.814965:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6e972 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e96b expref: 24 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814973:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6e972 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e96b expref: 24 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658418.814982:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658418.815003:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025175936:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658418.815010:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788658418.815059:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025175936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658418.815068:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025175808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658418.815098:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025175680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658418.815795:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b2600/0x48e67cc629c6e99c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e995 expref: 23 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.815812:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025175040:0@lo:104: 00000100:00100000:2.0:1788658418.815895:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025175168:0@lo:104: 00010000:00010000:2.0:1788658418.815910:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6e980 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e979 expref: 22 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.815919:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025175296:0@lo:104: 00010000:00010000:2.0:1788658418.815943:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6e972 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e96b expref: 21 pid: 6530 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.815952:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025175424:0@lo:104: 00010000:00010000:2.0:1788658418.816923:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658418.817012:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658418.817021:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658418.817028:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788658418.817081:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.817088:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788658418.817153:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025176064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658418.817239:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658418.817365:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025176064 00000100:00100000:2.0:1788658418.817375:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025176064 00010000:00010000:2.0:1788658418.817421:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3390e00/0x48e67cc629c6e98e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e987 expref: 21 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.817458:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788658418.817469:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3647:x1875544025176064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658418.817486:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658418.817492:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3390e00/0x48e67cc629c6e98e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e987 expref: 21 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.817502:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3390e00/0x48e67cc629c6e98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e987 expref: 21 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.817519:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390e00/0x48e67cc629c6e98e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e987 expref: 21 pid: 6529 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.817538:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658418.817601:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.817611:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6e987 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e98e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658418.817639:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658418.817641:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658418.817643:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658418.820449:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:3647:x1875544025176064:12345-0@lo:103:ldlm_bl.0 Request processed in 2968us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658418.820467:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788658418.820670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658418.820799:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658418.820876:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000974080 00000100:00100000:1.0:1788658418.820888:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000974080 00010000:00010000:1.0:1788658418.820932:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e9b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc67d expref: 13 pid: 6531 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658418.820968:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000974208 00000100:00100000:1.0:1788658418.820972:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000974208 00010000:00010000:1.0:1788658418.820985:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6e964 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc63e expref: 14 pid: 6530 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658418.820999:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:1.0:1788658418.821008:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+14:2397:x1875544000974080:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658418.821027:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658418.821033:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e9b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc67d expref: 14 pid: 6531 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821048:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc67d expref: 14 pid: 6531 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821092:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658418.821156:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+14:2397:x1875544000974080:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 149us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658418.821164:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:1.0:1788658418.821181:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:1.0:1788658418.821187:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000974208:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658418.821195:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658418.821200:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6e964 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc63e expref: 13 pid: 6530 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821209:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6e964 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc63e expref: 13 pid: 6530 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821222:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821231:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821250:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821258:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821265:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821273:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821286:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658418.821292:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821301:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821310:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658418.821323:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658418.821345:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84dbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000974208:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 159us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658418.821352:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00010000:00010000:2.0:1788658418.821756:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d0400/0x48e67cc629c6e9b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc67d expref: 12 pid: 6531 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.821777:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025174912:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658418.821800:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6e964 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc63e expref: 11 pid: 6530 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658418.821810:0:13203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13203:1875544025175552:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658418.821865:0:13203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.821876:0:13203:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.821882:0:13203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658418.821888:0:13203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d834a0000/0x48e67cc629c6e9d4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658418.826130:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025176064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658419.135313:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658419.647058:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025176192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658419.647170:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658419.647420:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025176320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658419.647482:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658419.647945:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025176192 00000100:00100000:3.0:1788658419.647958:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025176192 00000100:00100000:3.0:1788658419.648020:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025176320 00000100:00100000:3.0:1788658419.648121:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025176320 00000100:00100000:2.0:1788658419.648126:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658419.648135:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025176576:0@lo:400:kworker.0 00000100:00100000:3.0:1788658419.648150:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788658419.648159:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025176192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658419.648174:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788658419.648197:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788658419.648210:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658419.648475:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025176576 00000100:00100000:0.0:1788658419.648482:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025176576 00000100:00100000:0.0:1788658419.648516:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788658419.648525:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025176576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.648823:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025176448:0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.648860:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658419.649265:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025176448 00000100:00100000:2.0:1788658419.649272:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025176448 00000100:00100000:2.0:1788658419.649315:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788658419.649324:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025176448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.649394:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025176448:12345-0@lo:400:kworker.0 Request processed in 71us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658419.649402:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788658419.649462:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025176448:0@lo:400:kworker.0 00000100:00100000:3.0:1788658419.652487:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025176192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4313us (5302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658419.652505:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788658419.652553:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788658419.652573:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025176320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788658419.652605:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658419.652676:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025176320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (5194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658419.652682:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1788658419.652833:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83672d80 x1875544025176320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658419.652861:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025176320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658419.654420:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025176576:12345-0@lo:400:kworker.0 Request processed in 5885us (6232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658419.654436:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788658419.654969:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658419.654991:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025176704:0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.655065:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658419.655268:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025176704 00000100:00100000:2.0:1788658419.655278:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025176704 00000100:00100000:2.0:1788658419.655330:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788658419.655340:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025176704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.655396:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025176704:12345-0@lo:400:kworker.0 Request processed in 58us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658419.655403:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788658419.655460:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025176704:0@lo:400:kworker.0 00000100:00100000:1.0:1788658419.655666:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025177088:0@lo:400:kworker.0 00000100:00100000:1.0:1788658419.655699:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658419.656875:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025176576:0@lo:400:kworker.0 00010000:00080000:3.0:1788658419.656903:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831be300 x1875544025176192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658419.656927:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025176192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658419.656961:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025177216:0@lo:400:kworker.0 00000100:00100000:3.0:1788658419.657385:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658419.657475:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025177216 00000100:00100000:3.0:1788658419.657500:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025177216 00000100:00100000:3.0:1788658419.657567:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788658419.657579:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025177216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658419.657640:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025177216:12345-0@lo:400:kworker.0 Request processed in 64us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658419.657648:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1788658419.657682:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83673800 x1875544025177216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658419.657695:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025177216:0@lo:400:kworker.0 00000100:00100000:1.0:1788658419.659661:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025177600:0@lo:400:kworker.0 00000100:00100000:1.0:1788658419.659760:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658419.659822:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025177088 00000100:00100000:1.0:1788658419.659831:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025177088 00000100:00100000:1.0:1788658419.659887:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025177600 00000100:00100000:1.0:1788658419.660022:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025177600 00000100:00100000:1.0:1788658419.660058:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788658419.660068:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025177088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788658419.660193:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658419.660200:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658419.660224:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025176960:0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.660262:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658419.660292:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025177472:0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.660315:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658419.660357:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788658419.660364:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025176832:0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.660393:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658419.660413:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025177344:0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.660439:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658419.660479:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025177344 00000100:00100000:2.0:1788658419.660483:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025177344 00000100:00100000:2.0:1788658419.660519:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788658419.660525:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025177344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658419.660576:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025176960 00000100:00100000:3.0:1788658419.660581:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025176960 00000100:00100000:3.0:1788658419.660605:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025177472 00000100:00100000:3.0:1788658419.660608:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025177472 00000100:00100000:3.0:1788658419.660623:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788658419.660629:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025177600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658419.660663:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025177600:12345-0@lo:400:kworker.0 Request processed in 35us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658419.660664:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025177088:12345-0@lo:400:kworker.0 Request processed in 596us (4962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658419.660671:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788658419.660675:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788658419.660690:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788658419.660695:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025176960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.660731:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025177344:12345-0@lo:400:kworker.0 Request processed in 206us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658419.660739:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788658419.660754:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025176960:12345-0@lo:400:kworker.0 Request processed in 59us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658419.660882:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788658419.660902:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025177472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658419.660935:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025177472:12345-0@lo:400:kworker.0 Request processed in 46us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658419.660941:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788658419.661870:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:3.0:1788658419.661910:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658419.661916:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658419.662263:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025176832 00000100:00100000:1.0:1788658419.662274:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025176832 00000100:00100000:1.0:1788658419.662329:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788658419.662338:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025176832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658419.662427:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025176832:12345-0@lo:400:kworker.0 Request processed in 90us (2033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658419.662434:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:1.0:1788658419.662496:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83670700 x1875544025177088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658419.662515:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025177088:0@lo:400:kworker.0 00010000:00080000:1.0:1788658419.662531:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83670380 x1875544025177600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658419.662540:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025177600:0@lo:400:kworker.0 00010000:00080000:2.0:1788658419.662730:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83673100 x1875544025177344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658419.662742:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025177344:0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.662759:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025176960:0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.662771:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025177472:0@lo:400:kworker.0 00000100:00100000:2.0:1788658419.662796:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025176832:0@lo:400:kworker.0 00000100:00100000:0.0:1788658420.155550:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658420.155977:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000974336 00000100:00100000:2.0:1788658420.155992:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000974336 00000100:00100000:2.0:1788658420.156070:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 316 00000100:00100000:2.0:1788658420.156083:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e915d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+11:6171:x1875544000974336:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658420.156108:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658420.156135:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6e9db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6ae expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658420.156199:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6e9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ae expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658420.156213:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6e9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ae expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658420.156225:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1400, rc 0) 00000100:00100000:2.0:1788658420.156309:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e915d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000974336:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 228us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658420.156317:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 316 00000100:00100000:2.0:1788658420.160473:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658420.160508:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025177728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658420.160609:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658420.160890:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025177728 00000100:00100000:0.0:1788658420.160901:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025177728 00000100:00100000:0.0:1788658420.160964:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788658420.160972:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658420.160981:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025177728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658420.161021:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658420.161080:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025177728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658420.161088:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788658420.161125:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000974464 00010000:00080000:0.0:1788658420.161142:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bce00 x1875544025177728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658420.161157:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000974464 00000100:00100000:0.0:1788658420.161168:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025177728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658420.161199:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 317 00000100:00100000:3.0:1788658420.161209:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000974464:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658420.161386:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000974464:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 178us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658420.161405:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 317 00010000:00010000:2.0:1788658420.161967:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658420.161976:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658420.161993:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025177856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658420.162040:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658420.162201:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025177856 00000100:00100000:3.0:1788658420.162208:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025177856 00000100:00100000:3.0:1788658420.162244:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788658420.162252:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025177856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658420.162273:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658420.162443:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025177856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658420.162451:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1788658420.162498:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e9836ad80 x1875544025177856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658420.162518:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025177856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658420.165525:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658420.165761:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000974592 00000100:00100000:2.0:1788658420.165784:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000974592 00000100:00100000:2.0:1788658420.165847:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 318 00000100:00100000:2.0:1788658420.165859:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000974592:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658420.166039:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000974592:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 181us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658420.166048:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 318 00000100:00100000:3.0:1788658420.179901:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658420.181791:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000974720 00000100:00100000:2.0:1788658420.181837:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000974720 00000100:00100000:2.0:1788658420.181933:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 319 00000100:00100000:2.0:1788658420.181946:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000974720:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658420.181969:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658420.181996:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a0a00/0x48e67cc629c6e9e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6b5 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658420.182036:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a0a00/0x48e67cc629c6e9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6b5 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658420.182049:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a0a00/0x48e67cc629c6e9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6b5 expref: 13 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658420.182059:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0a00, rc 0) 00000100:00100000:2.0:1788658420.182152:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:6171:x1875544000974720:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 209us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658420.182160:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 319 00000100:00100000:3.0:1788658420.187312:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658420.187397:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000974848 00000100:00100000:0.0:1788658420.187410:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000974848 00000100:00100000:0.0:1788658420.187483:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 320 00000100:00100000:0.0:1788658420.187496:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:6171:x1875544000974848:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658420.187736:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:6171:x1875544000974848:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 242us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658420.187745:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 320 00000100:00100000:3.0:1788658420.196102:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658420.196262:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000974976 00000100:00100000:1.0:1788658420.196276:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000974976 00000100:00100000:1.0:1788658420.196357:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 321 00000100:00100000:1.0:1788658420.196371:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:6171:x1875544000974976:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.196578:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:6171:x1875544000974976:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 210us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658420.196595:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 321 10000000:01000000:1.0:1788658420.350899:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788658420.350910:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d8230c000 from 7 10000000:01000000:1.0:1788658420.350917:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658420.350991:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.351006:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.351020:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658420.351054:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025177984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.351152:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658420.351233:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658420.351442:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025177984 00000100:00100000:3.0:1788658420.351453:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025177984 00000100:00100000:3.0:1788658420.351524:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788658420.351536:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025177984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658420.351554:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658420.351571:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c6e9f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e9e9 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.351621:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c6e9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e9e9 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.351633:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c6e9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e9e9 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.351642:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96a00, rc 0) 00000100:00100000:3.0:1788658420.351738:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025177984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658420.351745:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788658420.351876:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025177984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658420.351897:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658420.351909:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658420.351993:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e98368e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658420.352024:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658420.352057:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8362ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658420.352101:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025178112 00000100:00100000:3.0:1788658420.352105:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025178112 00000100:00100000:3.0:1788658420.352139:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788658420.352147:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025178112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658420.352514:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025178112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 366us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658420.352521:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788658420.356604:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e98368e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658420.357192:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658420.357477:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658420.357535:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e87dadf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658420.357694:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025178240 00000100:00100000:2.0:1788658420.357739:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025178240 00000100:00100000:2.0:1788658420.357892:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788658420.357904:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025178240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658420.358059:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025178240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658420.358068:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788658420.358440:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788658420.362404:0:13234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788658420.362734:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788658420.362780:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658420.362797:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.362813:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658420.362827:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788658420.362830:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ebd8b1800 from 7 10000000:01000000:3.0:1788658420.362859:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658420.362929:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.362939:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.362953:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658420.362989:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658420.363082:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658420.363127:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824b8540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658420.363784:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025178368 00000100:00100000:1.0:1788658420.363797:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025178368 00000100:00100000:1.0:1788658420.363866:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788658420.363878:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025178368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658420.363896:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658420.363915:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb23b2800/0x48e67cc629c6e9fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6e9f7 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.363955:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb23b2800/0x48e67cc629c6e9fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6e9f7 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.363968:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb23b2800/0x48e67cc629c6e9fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e9f7 expref: 22 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.363999:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2800, rc 0) 00000100:00100000:1.0:1788658420.364066:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025178368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658420.364073:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788658420.364136:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658420.364155:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.364167:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658420.364246:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.364277:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658420.364304:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658420.364320:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025178496 00000100:00100000:1.0:1788658420.364324:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025178496 00000100:00100000:1.0:1788658420.364350:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788658420.364357:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025178496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.364502:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025178496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658420.364510:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788658420.364540:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.364893:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.364946:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658420.364968:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658420.364982:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025178624 00000100:00100000:1.0:1788658420.364986:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025178624 00000100:00100000:1.0:1788658420.365008:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788658420.365015:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025178624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.365098:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025178624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658420.365106:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788658420.365150:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788658420.366572:0:13235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788658420.367004:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788658420.367033:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788658420.367048:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.367060:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658420.367079:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788658420.367083:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ec11f4800 from 7 10000000:01000000:1.0:1788658420.367086:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658420.367143:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.367156:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.367168:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658420.367201:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.367337:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658420.367411:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658420.367483:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025178752 00000100:00100000:3.0:1788658420.367492:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025178752 00000100:00100000:3.0:1788658420.367561:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788658420.367578:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025178752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658420.367596:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658420.367615:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6ea0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6ea05 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.367646:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6ea0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6ea05 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.367670:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6ea0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6ea05 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.367681:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96c00, rc 0) 00000100:00100000:3.0:1788658420.367777:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025178752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658420.367795:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788658420.368313:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658420.368336:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.368347:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658420.368437:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.368479:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658420.368520:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375d780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658420.368829:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025178880 00000100:00100000:3.0:1788658420.368837:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025178880 00000100:00100000:3.0:1788658420.368880:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788658420.368888:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025178880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658420.369040:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025178880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658420.369049:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788658420.369212:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025178880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658420.369258:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025179008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658420.369339:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658420.369404:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8362ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658420.369557:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025179008 00000100:00100000:1.0:1788658420.369562:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025179008 00000100:00100000:1.0:1788658420.369606:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788658420.369614:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025179008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.369907:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025179008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 292us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658420.369915:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788658420.370091:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025179008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788658420.371521:0:13236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788658420.376078:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788658420.376129:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658420.376146:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658420.376162:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658420.378512:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788658420.378523:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ec1212800 from 7 10000000:01000000:1.0:1788658420.378530:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658420.378607:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.378622:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.378677:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658420.378735:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025179136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.379433:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658420.379495:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658420.380242:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025179136 00000100:00100000:3.0:1788658420.380256:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025179136 00000100:00100000:3.0:1788658420.380450:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:3.0:1788658420.380463:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025179136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658420.380484:0:6530:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658420.380507:0:6530:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ea1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6ea13 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.380542:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ea1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6ea13 expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.380555:0:6530:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ea1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6ea13 expref: 24 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658420.380567:0:6530:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96e00, rc 0) 00000100:00100000:3.0:1788658420.380665:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025179136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658420.380674:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788658420.380984:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025179136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658420.381007:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658420.381018:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658420.381115:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025179264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658420.381156:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658420.381195:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658420.381356:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025179264 00000100:00100000:0.0:1788658420.381363:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025179264 00000100:00100000:0.0:1788658420.381412:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788658420.381421:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025179264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658420.381759:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025179264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658420.381768:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1788658420.391220:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025179264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658420.391310:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025179392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658420.391421:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658420.391518:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8362ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658420.396887:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025179392 00000100:00100000:0.0:1788658420.396911:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025179392 00000100:00100000:0.0:1788658420.396990:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788658420.397001:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025179392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658420.398929:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025179392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1917us (7495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658420.398947:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788658420.400504:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025179392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788658420.409061:0:13239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788658420.409287:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788658420.409316:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658420.409330:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658420.409352:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658420.681855:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658420.681891:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025179520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658420.681992:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658420.682212:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025179520 00000100:00100000:2.0:1788658420.682224:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025179520 00000100:00100000:2.0:1788658420.683241:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788658420.683261:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025179520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658420.683322:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788658420.683425:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025179520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658420.683432:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788658420.684422:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025179520:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788658421.193752:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658421.953967:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658421.954023:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658421.954049:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658421.954071:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658421.954096:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658421.954125:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000975360 00000100:00100000:1.0:1788658421.954138:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000975360 00000100:00100000:1.0:1788658421.954231:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000975616 00000100:00100000:1.0:1788658421.954235:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000975616 00000100:00100000:1.0:1788658421.954252:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000975232 00000100:00100000:1.0:1788658421.954254:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000975232 00000100:00080000:3.0:1788658421.954255:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658421.954296:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658421.954296:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000975488 00000100:00100000:1.0:1788658421.954299:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000975488 00000100:00080000:3.0:1788658421.954327:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658421.954331:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 209 00000100:00100000:1.0:1788658421.954342:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000975360:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658421.954451:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000975360:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 110us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658421.954460:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 209 00000100:00100000:1.0:1788658421.954480:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 210 00000100:00100000:1.0:1788658421.954487:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000975616:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658421.954513:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000975616:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658421.954519:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 210 00000100:00100000:1.0:1788658421.954530:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 211 00000100:00100000:1.0:1788658421.954535:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000975232:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658421.954555:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544000975232:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 20us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658421.954561:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 211 00000100:00100000:1.0:1788658421.954571:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 212 00000100:00100000:1.0:1788658421.954576:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000975488:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658421.954599:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000975488:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658421.954605:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 212 00000100:00100000:2.0:1788658421.955022:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000975104 00000100:00100000:2.0:1788658421.955029:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000975104 00000100:00100000:2.0:1788658421.955070:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 334 00000100:00100000:2.0:1788658421.955077:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000975104:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658421.955120:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000975104:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 43us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658421.955126:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 334 00010000:00010000:0.0:1788658422.207275:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658423.233617:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658423.233812:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658423.233985:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025179648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658423.234104:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658423.234183:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025179648 00000100:00100000:1.0:1788658423.234192:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025179648 00000100:00100000:1.0:1788658423.234249:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788658423.234258:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025179648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658423.234301:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788658423.234347:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025179648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658423.234355:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788658423.234414:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025179648:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788658423.525203:0:13401:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788658424.261530:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658424.767207:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025179776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658424.767283:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658424.767455:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025179776 00000100:00100000:1.0:1788658424.767464:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025179776 00000100:00100000:1.0:1788658424.767524:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788658424.767536:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025179776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658424.767565:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658424.767612:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025179776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658424.767619:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1788658424.767661:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cc380 x1875544025179776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658424.767679:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025179776:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788658424.767770:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658424.769015:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025180160:0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.769071:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658424.769149:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025180672:0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.769174:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658424.769207:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025181184:0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.769229:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658424.769264:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788658424.769270:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025180288:0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.769293:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658424.769312:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025180800:0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.769335:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658424.769349:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025181312:0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.769366:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658424.769395:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025180800 00000100:00100000:0.0:1788658424.769401:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025180800 00000100:00100000:0.0:1788658424.769444:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025181312 00000100:00100000:0.0:1788658424.769448:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025181312 00000100:00100000:0.0:1788658424.769470:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788658424.769477:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025180800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.769521:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025180800:12345-0@lo:400:kworker.0 Request processed in 44us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658424.769544:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788658424.769561:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788658424.769567:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025181312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.769595:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025181312:12345-0@lo:400:kworker.0 Request processed in 29us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658424.769601:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1788658424.769636:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83670e00 x1875544025180800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658424.769648:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025180800:0@lo:400:kworker.0 00010000:00080000:0.0:1788658424.769659:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83671f80 x1875544025181312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658424.769668:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025181312:0@lo:400:kworker.0 00000100:00080000:0.0:1788658424.769724:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658424.769729:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658424.771199:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025180672 00000100:00100000:3.0:1788658424.771211:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025180672 00000100:00100000:3.0:1788658424.771282:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025181184 00000100:00100000:3.0:1788658424.771286:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025181184 00000100:00100000:3.0:1788658424.771306:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025180288 00000100:00100000:3.0:1788658424.771309:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025180288 00000100:00100000:3.0:1788658424.771324:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788658424.771333:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025180672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658424.771409:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025180672:12345-0@lo:400:kworker.0 Request processed in 77us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658424.771417:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788658424.771433:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788658424.771439:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025181184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658424.771468:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025181184:12345-0@lo:400:kworker.0 Request processed in 29us (2237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658424.771474:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788658424.771485:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788658424.771491:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025180288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658424.771518:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025180288:12345-0@lo:400:kworker.0 Request processed in 27us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658424.771524:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788658424.772157:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025179904:0@lo:400:kworker.0 00000100:00100000:1.0:1788658424.772211:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658424.772260:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025180416:0@lo:400:kworker.0 00000100:00100000:1.0:1788658424.772282:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658424.772332:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025179904 00000100:00100000:3.0:1788658424.772343:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025179904 00000100:00100000:3.0:1788658424.772377:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788658424.772383:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025179904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658424.772411:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025179904:12345-0@lo:400:kworker.0 Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658424.772416:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788658424.772466:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025180032:0@lo:400:kworker.0 00000100:00100000:3.0:1788658424.772488:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658424.772502:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025180544:0@lo:400:kworker.0 00000100:00100000:3.0:1788658424.772517:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658424.772527:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025181056:0@lo:400:kworker.0 00000100:00100000:3.0:1788658424.772541:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658424.772561:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025180032 00000100:00100000:3.0:1788658424.772563:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025180032 00000100:00080000:0.0:1788658424.772732:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658424.772768:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025180288:0@lo:400:kworker.0 00010000:00080000:0.0:1788658424.772782:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83672d80 x1875544025180672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658424.772794:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025180672:0@lo:400:kworker.0 00010000:00080000:0.0:1788658424.772811:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83673800 x1875544025181184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658424.772822:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025181184:0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.772860:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025180544 00000100:00100000:0.0:1788658424.772868:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025180544 00000100:00100000:0.0:1788658424.772902:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025181056 00000100:00100000:0.0:1788658424.772905:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025181056 00000100:00100000:0.0:1788658424.772917:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788658424.772921:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025180032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.772954:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025180032:12345-0@lo:400:kworker.0 Request processed in 32us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658424.772959:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788658424.772968:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788658424.772973:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025180544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.772990:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025180544:12345-0@lo:400:kworker.0 Request processed in 18us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658424.773006:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788658424.773017:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788658424.773021:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025181056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.773041:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025181056:12345-0@lo:400:kworker.0 Request processed in 20us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658424.773046:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:0.0:1788658424.773058:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658424.773972:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025180032:0@lo:400:kworker.0 00000100:00100000:0.0:1788658424.773985:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025180544:0@lo:400:kworker.0 00000100:00100000:1.0:1788658424.774408:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025180928:0@lo:400:kworker.0 00000100:00100000:1.0:1788658424.774453:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658424.774477:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025181440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658424.774519:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658424.774552:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025179904:0@lo:400:kworker.0 00000100:00100000:1.0:1788658424.774581:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025181440 00000100:00100000:1.0:1788658424.774586:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025181440 00000100:00100000:1.0:1788658424.774621:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788658424.774629:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025181440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658424.774649:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658424.774685:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025181440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658424.774692:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788658424.774730:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025180928 00000100:00100000:1.0:1788658424.774734:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025180928 00000100:00100000:1.0:1788658424.774768:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788658424.774775:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025180928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658424.774807:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025180928:12345-0@lo:400:kworker.0 Request processed in 33us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658424.774813:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788658424.774830:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788658424.774848:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83673100 x1875544025180928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658424.774858:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025180928:0@lo:400:kworker.0 00010000:00080000:1.0:1788658424.774867:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bce00 x1875544025181440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658424.774908:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025181440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658424.775430:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025181056:0@lo:400:kworker.0 00000100:00100000:2.0:1788658424.775573:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025180160 00000100:00100000:2.0:1788658424.775580:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025180160 00000100:00100000:2.0:1788658424.775612:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025180416 00000100:00100000:2.0:1788658424.775615:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025180416 00000100:00100000:2.0:1788658424.775630:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788658424.775637:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025180160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658424.775691:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025180160:12345-0@lo:400:kworker.0 Request processed in 54us (6619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658424.775698:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788658424.775738:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788658424.775745:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025180416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658424.775779:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025180416:12345-0@lo:400:kworker.0 Request processed in 36us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658424.775785:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788658424.775938:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025180160:0@lo:400:kworker.0 00000100:00100000:1.0:1788658424.776679:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025180416:0@lo:400:kworker.0 00010000:00010000:0.0:1788658425.280907:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658425.280992:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025181568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658425.281064:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658425.281241:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025181568 00000100:00100000:1.0:1788658425.281249:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025181568 00000100:00100000:1.0:1788658425.281297:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788658425.281306:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025181568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658425.281333:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658425.281377:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025181568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658425.281384:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1788658425.281419:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d831bd880 x1875544025181568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658425.281436:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025181568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658425.284142:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025181696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658425.284211:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658425.284299:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025181696 00000100:00100000:1.0:1788658425.284307:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025181696 00000100:00100000:1.0:1788658425.284358:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788658425.284367:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025181696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658425.284387:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658425.284444:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025181696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658425.284450:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:3.0:1788658425.285691:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ee9180 x1875544025181696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658425.285753:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025181696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658425.796173:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d832e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025181824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658425.796261:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658425.796446:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025181824 00000100:00100000:2.0:1788658425.796455:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025181824 00000100:00100000:2.0:1788658425.796508:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788658425.796518:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025181824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658425.796555:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788658425.796612:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025181824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658425.796619:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788658425.796735:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d832e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025181824:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658426.302893:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658427.066729:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658427.066772:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658427.066803:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658427.066836:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658427.066862:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658427.066889:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000976000 00000100:00100000:1.0:1788658427.066898:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000976000 00000100:00100000:1.0:1788658427.066958:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000976256 00000100:00100000:1.0:1788658427.066961:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000976256 00000100:00100000:1.0:1788658427.066974:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000975872 00000100:00100000:1.0:1788658427.066976:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000975872 00000100:00100000:1.0:1788658427.066991:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000976128 00000100:00100000:1.0:1788658427.066993:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000976128 00000100:00100000:1.0:1788658427.067008:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 219 00000100:00100000:1.0:1788658427.067018:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000976000:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658427.067088:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000976000:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 71us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658427.067096:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 219 00000100:00100000:1.0:1788658427.067113:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 220 00000100:00100000:1.0:1788658427.067119:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000976256:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658427.067145:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000976256:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658427.067151:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 220 00000100:00100000:1.0:1788658427.067163:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 221 00000100:00100000:1.0:1788658427.067168:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544000975872:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658427.067190:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544000975872:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658427.067196:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 221 00000100:00100000:1.0:1788658427.067207:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 222 00000100:00100000:1.0:1788658427.067221:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000976128:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658427.067244:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000976128:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658427.067249:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 222 00000100:00080000:1.0:1788658427.067273:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658427.067278:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658427.067517:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000975744 00000100:00100000:2.0:1788658427.067522:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000975744 00000100:00100000:2.0:1788658427.067552:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 336 00000100:00100000:2.0:1788658427.067559:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544000975744:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658427.067599:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544000975744:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 41us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658427.067605:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 336 00010000:00010000:0.0:1788658427.328657:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658428.352642:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025181952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658428.352759:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658428.352951:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025181952 00000100:00100000:0.0:1788658428.352959:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025181952 00000100:00100000:0.0:1788658428.353020:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788658428.353030:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025181952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658428.353064:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788658428.353117:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025181952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658428.353124:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788658428.353171:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025181952:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788658428.354884:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658429.377304:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788658429.608671:0:13550:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:33:47 (1788658427) === 00000100:00100000:3.0:1788658429.777108:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658429.777219:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658429.777255:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000976384 00000100:00100000:3.0:1788658429.777264:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000976384 00000100:00100000:3.0:1788658429.777405:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1788658429.777416:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544000976384:12345-192.168.202.53@tcp:41:mkdir.0 00000004:00000024:3.0:1788658429.777457:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788658429.777538:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544000976384:12345-192.168.202.53@tcp:41:mkdir.0 Request processed in 124us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658429.777551:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1788658429.777581:0:6546:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000976512 00000100:00100000:3.0:1788658429.777585:0:6546:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000976512 00000100:00100000:3.0:1788658429.777611:0:6546:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1788658429.777619:0:6546:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:10491:x1875544000976512:12345-192.168.202.53@tcp:700:mkdir.0 00000100:00100000:3.0:1788658429.777653:0:6546:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:10491:x1875544000976512:12345-192.168.202.53@tcp:700:mkdir.0 Request processed in 35us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658429.777660:0:6546:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00080000:3.0:1788658429.777676:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658429.782027:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658429.782141:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000976768 00000100:00100000:2.0:1788658429.782164:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000976768 00000100:00100000:2.0:1788658429.782219:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:2.0:1788658429.782229:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:10491:x1875544000976768:12345-192.168.202.53@tcp:36:mkdir.0 00010000:00010000:2.0:1788658429.782284:0:7958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658429.782354:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6e8c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc629 expref: 6 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.782375:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83404300) 00010000:00010000:2.0:1788658429.782386:0:7958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658429.782514:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ea21 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.782530:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ea21 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.782540:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ea21 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.782568:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.782577:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.782584:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783256:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783269:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783284:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658429.783301:0:7958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051eb8e5b reply state 0000000044ea2882 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783312:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783328:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1d83404900) 00010000:00010000:2.0:1788658429.783332:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788658429.783335:0:7958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788658429.783340:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788658429.783346:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ea21 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783353:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ea21 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783360:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ea21 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783366:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658429.783370:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ea21 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783379:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ea21 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783388:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83404400) 00010000:00010000:2.0:1788658429.783391:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658429.783403:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ea21 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783410:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ea21 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658429.783424:0:7958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051eb8e5b reply state 0000000044ea2882 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783433:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.783439:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a1d83404500) 00010000:00010000:2.0:1788658429.783441:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788658429.783443:0:7958:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788658429.783533:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:10491:x1875544000976768:12345-192.168.202.53@tcp:36:mkdir.0 Request processed in 1302us (1528us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788658429.783541:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:3.0:1788658429.805167:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658429.805239:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000976896 00000100:00100000:1.0:1788658429.805253:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000976896 00000100:00100000:1.0:1788658429.805329:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1788658429.805342:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:10492:x1875544000976896:12345-192.168.202.53@tcp:101:chmod.0 00010000:00010000:1.0:1788658429.805364:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658429.805390:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ea36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6bc expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.805458:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.805475:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.805491:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658429.805540:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788658429.805543:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658429.805593:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.805622:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ea36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6bc expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.805647:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6bc expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.805656:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0f00) 00010000:00010000:1.0:1788658429.805659:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658429.805663:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419000, rc 0) 00000100:00100000:1.0:1788658429.805745:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:10492:x1875544000976896:12345-192.168.202.53@tcp:101:chmod.0 Request processed in 406us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658429.805752:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:3.0:1788658429.809106:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658429.814738:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000977152 00000100:00100000:1.0:1788658429.814750:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000977152 00000100:00100000:1.0:1788658429.814815:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1788658429.814827:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:10492:x1875544000977152:12345-192.168.202.53@tcp:36:chmod.0 00010000:00010000:1.0:1788658429.815088:0:11974:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658429.815121:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6bc expref: 8 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.815141:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0f00) 00010000:00010000:1.0:1788658429.815153:0:11974:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658429.815179:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.815192:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.815201:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788658429.815417:0:11974:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eda5a28b reply state 0000000023435995 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.815429:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.815436:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0600) 00010000:00010000:1.0:1788658429.815438:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788658429.815441:0:11974:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788658429.815447:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788658429.815534:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83468000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:10492:x1875544000977152:12345-192.168.202.53@tcp:36:chmod.0 Request processed in 709us (6612us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788658429.815542:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:2.0:1788658429.852359:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658429.852419:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000977280 00000100:00100000:3.0:1788658429.852428:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000977280 00000100:00100000:3.0:1788658429.852481:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:3.0:1788658429.852492:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:10493:x1875544000977280:12345-192.168.202.53@tcp:101:chown.0 00010000:00010000:3.0:1788658429.852519:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658429.852544:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6c3 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.852608:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6ea52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.852623:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6ea52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.852635:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6ea52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658429.852698:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788658429.852737:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658429.852896:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6ea52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.852924:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6c3 expref: 11 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.852943:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6ea52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6c3 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.852952:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0600) 00010000:00010000:3.0:1788658429.852955:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658429.852959:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97a00, rc 0) 00000100:00100000:3.0:1788658429.854168:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:10493:x1875544000977280:12345-192.168.202.53@tcp:101:chown.0 Request processed in 1670us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658429.854180:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:1.0:1788658429.859148:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658429.859414:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000977408 00000100:00100000:0.0:1788658429.859424:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000977408 00000100:00100000:0.0:1788658429.859490:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:0.0:1788658429.859500:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:10493:x1875544000977408:12345-192.168.202.53@tcp:101:chown.0 00010000:00010000:0.0:1788658429.859520:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658429.859546:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ea59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6ca expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859626:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ea60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859658:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ea60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859671:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ea60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859685:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6ea67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859692:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6ea67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859699:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6ea67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859831:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6ea6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859840:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6ea6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859849:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6ea6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658429.859891:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788658429.859895:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658429.859916:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6ea6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859934:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ea60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859950:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ea60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859957:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ea60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859962:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658429.859966:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ea60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859973:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ea60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859984:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0600) 00010000:00010000:0.0:1788658429.859987:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658429.859991:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ea60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.859998:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ea60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.860022:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6ea67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.860029:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6ea67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.860035:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6ea67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.860040:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658429.860049:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6ea67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.860055:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6ea67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.860064:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a1d83404500) 00010000:00010000:0.0:1788658429.860066:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658429.860070:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6ea67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.860076:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6ea67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.860104:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ea59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ca expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.860118:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6ea6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ca expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.860125:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1d83404900) 00010000:00010000:0.0:1788658429.860127:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658429.860130:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d0200, rc 0) 00000100:00100000:0.0:1788658429.860190:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:10493:x1875544000977408:12345-192.168.202.53@tcp:101:chown.0 Request processed in 691us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658429.860197:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:0.0:1788658429.863403:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658429.863729:0:6547:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000977536 00000100:00100000:2.0:1788658429.863740:0:6547:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000977536 00000100:00100000:2.0:1788658429.863795:0:6547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1788658429.863805:0:6547:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:10493:x1875544000977536:12345-192.168.202.53@tcp:900:chown.0 00000100:00100000:2.0:1788658429.863887:0:6547:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:10493:x1875544000977536:12345-192.168.202.53@tcp:900:chown.0 Request processed in 83us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658429.863895:0:6547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1788658429.867462:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658429.867575:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000977792 00000100:00100000:1.0:1788658429.867586:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000977792 00000100:00100000:1.0:1788658429.867657:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:1.0:1788658429.867669:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:10493:x1875544000977792:12345-192.168.202.53@tcp:36:chown.0 00010000:00010000:1.0:1788658429.867792:0:11974:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658429.867822:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6ea6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ca expref: 11 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.867852:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1d83404900) 00010000:00010000:1.0:1788658429.867857:0:11974:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658429.867885:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.867897:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.867922:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658429.872073:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:1.0:1788658429.872738:0:11974:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009ca5372 reply state 000000002b95439d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.872763:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658429.872772:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1d83404900) 00010000:00010000:1.0:1788658429.872775:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788658429.872779:0:11974:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788658429.872792:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1788658429.872895:0:11974:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788658429.872913:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:10493:x1875544000977792:12345-192.168.202.53@tcp:36:chown.0 Request processed in 5243us (5458us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788658429.872921:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00010000:00010000:3.0:1788658429.873149:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.873159:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.873166:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.873172:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658429.873177:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.873200:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.873222:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1d83404900) 00010000:00010000:3.0:1788658429.873225:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788658429.873229:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.873236:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419000/0x48e67cc629c6ea75 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880466:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880509:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880518:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880524:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658429.880529:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880540:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880561:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a1d83404500) 00010000:00010000:2.0:1788658429.880564:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658429.880570:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880577:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ea28 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880760:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880777:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880782:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880787:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658429.880796:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880803:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880812:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1d83404900) 00010000:00010000:2.0:1788658429.880815:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658429.880818:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880824:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ea2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880841:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880848:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880854:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880859:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658429.880862:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880868:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880876:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0600) 00010000:00010000:2.0:1788658429.880878:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788658429.880888:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658429.880894:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419e00/0x48e67cc629c6ea44 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658429.887034:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025182208:0@lo:400:kworker.0 00000100:00100000:3.0:1788658429.887106:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658429.887160:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025182720:0@lo:400:kworker.0 00000100:00100000:3.0:1788658429.887184:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658429.887415:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025182464:0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.887449:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658429.887472:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025182976:0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.887499:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658429.887518:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025183488:0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.887539:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658429.887566:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788658429.887572:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025182080:0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.887615:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658429.887640:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025182592:0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.887666:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658429.887685:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025183104:0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.887733:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658429.887753:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025183616:0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.887774:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658429.887803:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025182976 00000100:00100000:2.0:1788658429.887810:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025182976 00000100:00100000:2.0:1788658429.887856:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025183488 00000100:00100000:2.0:1788658429.887859:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025183488 00000100:00100000:2.0:1788658429.887871:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025183104 00000100:00100000:2.0:1788658429.887874:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025183104 00000100:00100000:2.0:1788658429.887885:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025183616 00000100:00100000:2.0:1788658429.887897:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025183616 00000100:00100000:2.0:1788658429.887918:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788658429.887927:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025182976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.887979:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025182976:12345-0@lo:400:kworker.0 Request processed in 53us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658429.887985:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788658429.888014:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788658429.888023:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025183488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.888050:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025183488:12345-0@lo:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658429.888056:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788658429.888067:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788658429.888073:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025183104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.888099:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025183104:12345-0@lo:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658429.888104:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788658429.888113:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788658429.888119:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025183616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.888145:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025183616:12345-0@lo:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658429.888151:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788658429.888173:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025182080 00000100:00100000:2.0:1788658429.888177:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025182080 00000100:00100000:2.0:1788658429.888201:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788658429.888395:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025182080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.888428:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025182080:12345-0@lo:400:kworker.0 Request processed in 37us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658429.888441:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788658429.888471:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025182592 00000100:00100000:2.0:1788658429.888476:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025182592 00000100:00100000:2.0:1788658429.888502:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788658429.888509:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025182592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.888542:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025182592:12345-0@lo:400:kworker.0 Request processed in 33us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658429.888548:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1788658429.888577:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658429.888580:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658429.888604:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025182080:0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.888618:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025182592:0@lo:400:kworker.0 00010000:00080000:2.0:1788658429.888631:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8346bb80 x1875544025183104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658429.888643:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025183104:0@lo:400:kworker.0 00010000:00080000:2.0:1788658429.888654:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e812aad80 x1875544025183616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658429.888663:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025183616:0@lo:400:kworker.0 00010000:00080000:2.0:1788658429.888673:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83469180 x1875544025182976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658429.888681:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025182976:0@lo:400:kworker.0 00010000:00080000:2.0:1788658429.888691:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e812a9f80 x1875544025183488/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658429.888736:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025183488:0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.888772:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025182208 00000100:00100000:2.0:1788658429.888776:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025182208 00000100:00100000:2.0:1788658429.888803:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025182720 00000100:00100000:2.0:1788658429.888806:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025182720 00000100:00100000:2.0:1788658429.888827:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025182464 00000100:00100000:2.0:1788658429.888831:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025182464 00000100:00100000:2.0:1788658429.888842:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788658429.888848:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025182208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.888881:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025182208:12345-0@lo:400:kworker.0 Request processed in 33us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658429.888887:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788658429.888899:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788658429.888904:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025182720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.888929:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025182720:12345-0@lo:400:kworker.0 Request processed in 26us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658429.888935:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788658429.888945:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788658429.888951:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025182464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658429.888978:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025182464:12345-0@lo:400:kworker.0 Request processed in 28us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658429.888984:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:2.0:1788658429.888997:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658429.889129:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025182336:0@lo:400:kworker.0 00000100:00100000:0.0:1788658429.889164:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658429.889198:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025182848:0@lo:400:kworker.0 00000100:00100000:0.0:1788658429.889239:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658429.889258:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025183360:0@lo:400:kworker.0 00000100:00100000:0.0:1788658429.889280:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658429.889304:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025182336 00000100:00100000:0.0:1788658429.889320:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025182336 00000100:00100000:0.0:1788658429.889347:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788658429.889355:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025182336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658429.889390:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025182336:12345-0@lo:400:kworker.0 Request processed in 36us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658429.889396:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788658429.889429:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025182336:0@lo:400:kworker.0 00000100:00100000:0.0:1788658429.889446:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025182848 00000100:00100000:0.0:1788658429.889449:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025182848 00000100:00100000:1.0:1788658429.889585:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025183872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658429.889614:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658429.889633:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658429.889639:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025183744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658429.889659:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658429.889683:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025183872 00000100:00100000:1.0:1788658429.889687:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025183872 00000100:00100000:1.0:1788658429.889722:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025183744 00000100:00100000:1.0:1788658429.889726:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025183744 00000100:00100000:1.0:1788658429.889739:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788658429.889746:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025183872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658429.889778:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658429.889815:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025183872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658429.889822:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788658429.889834:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788658429.889840:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025183744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658429.889849:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658429.889870:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025183744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658429.889875:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1788658429.889903:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3d500 x1875544025183744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658429.889918:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025183744:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788658429.889929:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3dc00 x1875544025183872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658429.889938:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025183872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658429.889959:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025183360 00000100:00100000:1.0:1788658429.889963:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025183360 00000100:00100000:2.0:1788658429.890048:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83468700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025182464:0@lo:400:kworker.0 00000100:00100000:3.0:1788658429.890346:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025183232:0@lo:400:kworker.0 00000100:00100000:3.0:1788658429.890396:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658429.890437:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025182208:0@lo:400:kworker.0 00000100:00100000:3.0:1788658429.890450:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025182720:0@lo:400:kworker.0 00000100:00100000:3.0:1788658429.890475:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025183232 00000100:00100000:3.0:1788658429.890479:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025183232 00000100:00100000:0.0:1788658429.891924:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788658429.891940:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025182848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658429.892029:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025182848:12345-0@lo:400:kworker.0 Request processed in 95us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658429.892037:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00080000:0.0:1788658429.892132:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8346b480 x1875544025182848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658429.892145:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025182848:0@lo:400:kworker.0 00000100:00100000:1.0:1788658429.892682:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788658429.892691:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025183360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658429.892751:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025183360:12345-0@lo:400:kworker.0 Request processed in 62us (3470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658429.892758:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00010000:00080000:1.0:1788658429.892786:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e812ab100 x1875544025183360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658429.892810:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025183360:0@lo:400:kworker.0 00000100:00100000:3.0:1788658429.893069:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788658429.893079:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025183232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658429.893122:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025183232:12345-0@lo:400:kworker.0 Request processed in 45us (2726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658429.893129:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788658429.893168:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025183232:0@lo:400:kworker.0 00000100:00080000:2.0:1788658429.894829:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658429.894853:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658429.904820:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658429.904919:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000977920 00000100:00100000:1.0:1788658429.904930:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000977920 00000100:00100000:1.0:1788658429.905015:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:1.0:1788658429.905026:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:10494:x1875544000977920:12345-192.168.202.53@tcp:101:touch.500 00010000:00010000:1.0:1788658429.905056:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658429.905082:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ea7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6d1 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658429.906314:0:11974:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1167us 00010000:00010000:3.0:1788658429.928890:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.928911:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.928924:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.928941:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6ea8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.928948:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6ea8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.928954:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6ea8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.929872:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ea91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.929887:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ea91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.929896:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ea91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658429.929931:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788658429.929935:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658429.929974:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ea91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930016:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930022:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea83 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930029:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930035:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658429.930039:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930048:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930061:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0600) 00010000:00010000:3.0:1788658429.930064:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658429.930069:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930076:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6ea83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930088:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6ea8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930096:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6ea8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930102:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6ea8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930114:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658429.930117:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6ea8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930123:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6ea8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930132:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a1ec21e9d00) 00010000:00010000:3.0:1788658429.930134:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658429.930137:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6ea8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930144:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6ea8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930184:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ea7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6d1 expref: 8 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930337:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ea91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6d1 expref: 7 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.930346:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1ec21e9b00) 00010000:00010000:3.0:1788658429.930349:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788658429.930351:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96600, rc 0) 00000100:00100000:3.0:1788658429.930425:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:10494:x1875544000977920:12345-192.168.202.53@tcp:101:touch.500 Request processed in 25400us (25615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658429.930435:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:0.0:1788658429.934980:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658429.935089:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000978176 00000100:00100000:3.0:1788658429.935106:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000978176 00000100:00100000:3.0:1788658429.935315:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:3.0:1788658429.935330:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:10494:x1875544000978176:12345-192.168.202.53@tcp:101:touch.500 00010000:00010000:3.0:1788658429.935354:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658429.935377:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6ea98 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6d8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.935491:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6ea9f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.935506:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6ea9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.935518:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6ea9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.935887:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.935898:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.935905:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658429.936458:0:6537:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788658429.936792:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6eaad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936804:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6eaad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936826:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6eaad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936863:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6ea9f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936871:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6ea9f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936879:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6ea9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936884:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658429.936889:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6ea9f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936895:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6ea9f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936907:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1ec21e9b00) 00010000:00010000:3.0:1788658429.936909:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658429.936915:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6ea9f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936921:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6ea9f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658429.936936:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d45bcb06 reply state 00000000e72f92c8 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936947:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.936962:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x71bb9c26 (ffff8a1ec21e9300) 00010000:00010000:3.0:1788658429.936964:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658429.936966:0:6537:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788658429.937004:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6ea98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6d8 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.937020:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6eaad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6d8 expref: 9 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.937027:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a1ec21e9200) 00010000:00010000:3.0:1788658429.937030:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658429.937032:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031800, rc 0) 00000100:00100000:3.0:1788658429.937105:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:10494:x1875544000978176:12345-192.168.202.53@tcp:101:touch.500 Request processed in 1778us (2136us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788658429.937113:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:3.0:1788658429.940802:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658429.940892:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000978432 00000100:00100000:0.0:1788658429.940904:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000978432 00000100:00100000:0.0:1788658429.940970:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:0.0:1788658429.940980:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:10494:x1875544000978432:12345-192.168.202.53@tcp:36:touch.500 00010000:00010000:0.0:1788658429.941040:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658429.941065:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6eaad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6d8 expref: 10 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.941087:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a1ec21e9200) 00010000:00010000:0.0:1788658429.941099:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658429.941156:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.941169:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.941179:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658429.941453:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006714f813 reply state 0000000092e2d123 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.941467:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658429.941473:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a1eb24ba400) 00010000:00010000:0.0:1788658429.941476:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658429.941479:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658429.941574:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:10494:x1875544000978432:12345-192.168.202.53@tcp:36:touch.500 Request processed in 595us (784us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788658429.942447:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:1.0:1788658429.945169:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658429.945296:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000978560 00000100:00100000:3.0:1788658429.945316:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000978560 00000100:00100000:3.0:1788658429.945390:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:3.0:1788658429.945402:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:10494:x1875544000978560:12345-192.168.202.53@tcp:101:touch.500 00010000:00010000:3.0:1788658429.945432:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658429.945453:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6eac2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6df expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.945514:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6eac2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6df expref: 12 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.945550:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6eac2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6df expref: 12 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658429.945571:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a1eb24ba400) 00010000:00010000:3.0:1788658429.945575:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658429.945579:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031400, rc 0) 00000100:00100000:3.0:1788658429.945643:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+12:10494:x1875544000978560:12345-192.168.202.53@tcp:101:touch.500 Request processed in 243us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658429.945652:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:3.0:1788658429.952757:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658429.952847:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000978688 00000100:00100000:0.0:1788658429.952858:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000978688 00000100:00100000:0.0:1788658429.952909:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:0.0:1788658429.952919:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875544000978688:12345-192.168.202.53@tcp:8:touch.500 00010000:00080000:0.0:1788658429.952957:0:8452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:0.0:1788658429.952990:0:8452:0:(genops.c:1385:class_connect()) connect: client 8cbe5c26-08aa-4214-8c09-2005fb4b10e9, cookie 0x48e67cc629c6eac9 00002000:00100000:0.0:1788658429.953003:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8cbe5c26-08aa-4214-8c09-2005fb4b10e9/ffff8a1d835f1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658429.953016:0:8452:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658429.953097:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788658429.953128:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8a1d835f3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658429.953192:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2395:x1875544000978688:12345-192.168.202.53@tcp:8:touch.500 Request processed in 273us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658429.953210:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1788658429.956639:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658429.956824:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000978816 00000100:00100000:2.0:1788658429.956835:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000978816 00000100:00100000:1.0:1788658429.956995:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1788658429.957007:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:0:x1875544000978816:12345-192.168.202.53@tcp:2:touch.500 00000100:00080000:0.0:1788658429.957215:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788658429.966926:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1788658429.966942:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000100:00100000:1.0:1788658429.967151:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:0:x1875544000978816:12345-192.168.202.53@tcp:2:touch.500 Request processed in 10140us (10515us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788658429.967163:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1788658429.971289:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658429.972052:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000979072 00000100:00100000:3.0:1788658429.972064:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000979072 00000100:00100000:0.0:1788658429.972661:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:0.0:1788658429.972677:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+12:10494:x1875544000979072:12345-192.168.202.53@tcp:35:touch.500 00000100:00100000:2.0:1788658429.972999:0:6539:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788658429.973010:0:6539:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1788658429.973521:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:10494:x1875544000979072:12345-192.168.202.53@tcp:35:touch.500 Request processed in 845us (2239us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788658429.973531:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1788658430.007537:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658430.007690:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000979200 00000100:00100000:2.0:1788658430.007739:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000979200 00000100:00100000:2.0:1788658430.007791:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:2.0:1788658430.007801:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:10495:x1875544000979200:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:2.0:1788658430.007824:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658430.007845:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ead0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6e6 expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.007911:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6ead7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.007925:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6ead7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.007937:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6ead7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658430.007982:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788658430.007986:0:7958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658430.008025:0:7958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6ead7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.008052:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ead0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6e6 expref: 15 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.008069:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6ead7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6e6 expref: 14 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.008093:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1ec21e9b00) 00010000:00010000:2.0:1788658430.008095:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658430.008099:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0600, rc 0) 00000100:00100000:2.0:1788658430.008165:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:10495:x1875544000979200:12345-192.168.202.53@tcp:101:rm.0 Request processed in 364us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658430.008172:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:1.0:1788658430.015658:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658430.015780:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000979456 00000100:00100000:0.0:1788658430.015792:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000979456 00000100:00100000:0.0:1788658430.015866:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:0.0:1788658430.015876:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:10495:x1875544000979456:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:0.0:1788658430.015906:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658430.015928:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6ed expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658430.016031:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788658430.016168:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eade lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ed expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.016185:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0600) 00010000:00010000:0.0:1788658430.016188:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658430.016206:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ed expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.016223:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1c00, rc 0) 00000100:00100000:0.0:1788658430.016305:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:10495:x1875544000979456:12345-192.168.202.53@tcp:101:rm.0 Request processed in 431us (656us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1788658430.016313:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:1.0:1788658430.024810:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658430.024902:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000979584 00000100:00100000:0.0:1788658430.024913:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000979584 00000100:00100000:0.0:1788658430.024977:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:0.0:1788658430.024988:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:10495:x1875544000979584:12345-192.168.202.53@tcp:37:rm.0 00000100:00100000:0.0:1788658430.031230:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:10495:x1875544000979584:12345-192.168.202.53@tcp:37:rm.0 Request processed in 6234us (6424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658430.031245:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:2.0:1788658430.039188:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658430.039360:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000979840 00000100:00100000:1.0:1788658430.039371:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000979840 00000100:00100000:1.0:1788658430.039470:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:1.0:1788658430.039480:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:10495:x1875544000979840:12345-192.168.202.53@tcp:35:rm.0 00000100:00100000:1.0:1788658430.039831:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:10495:x1875544000979840:12345-192.168.202.53@tcp:35:rm.0 Request processed in 351us (651us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788658430.039852:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:3.0:1788658430.043763:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658430.043915:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000980096 00000100:00100000:0.0:1788658430.043939:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000980096 00000100:00100000:0.0:1788658430.044006:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:0.0:1788658430.044018:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:10495:x1875544000980096:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:0.0:1788658430.044043:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658430.044065:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eaec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6f4 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.044185:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eaf3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.044218:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eaf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.044229:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eaf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658430.044239:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788658430.044389:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eaec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6f4 expref: 19 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.044411:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eaf3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6f4 expref: 18 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.044421:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1ec21e9b00) 00010000:00010000:0.0:1788658430.044424:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658430.044427:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1200, rc 0) 00000100:00100000:0.0:1788658430.044499:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:10495:x1875544000980096:12345-192.168.202.53@tcp:101:rm.0 Request processed in 483us (746us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788658430.044507:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:1.0:1788658430.049105:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658430.049263:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000980224 00000100:00100000:0.0:1788658430.049274:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000980224 00000100:00100000:0.0:1788658430.049383:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:0.0:1788658430.049395:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:10495:x1875544000980224:12345-192.168.202.53@tcp:41:rm.0 00000004:00000024:0.0:1788658430.049454:0:6536:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788658430.049532:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:10495:x1875544000980224:12345-192.168.202.53@tcp:41:rm.0 Request processed in 138us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658430.049539:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:2.0:1788658430.052305:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658430.053151:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000980352 00000100:00100000:1.0:1788658430.053162:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000980352 00000100:00100000:1.0:1788658430.053300:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:1.0:1788658430.053311:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:10495:x1875544000980352:12345-192.168.202.53@tcp:101:rm.0 00010000:00010000:1.0:1788658430.053333:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658430.053355:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6eb01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc6fb expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.053653:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6eb08 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.053670:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6eb08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.053681:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6eb08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.053693:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eb0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.053720:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.053728:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.053826:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6eb16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.053849:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6eb16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.053856:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6eb16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658430.054076:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788658430.054080:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658430.054101:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6eb16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054113:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6eb16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054121:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6eb08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054127:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6eb08 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054133:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6eb08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054138:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658430.054142:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6eb08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054150:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6eb08 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054162:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1ec21e9b00) 00010000:00010000:1.0:1788658430.054165:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658430.054176:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6eb08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054183:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6eb08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054209:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eb0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054215:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eb0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054220:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eb0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054224:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658430.054227:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eb0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054232:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eb0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054240:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x71bb9c26 (ffff8a1ec21e9300) 00010000:00010000:1.0:1788658430.054242:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658430.054244:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eb0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054249:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eb0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054274:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6eb01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6fb expref: 20 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054314:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6eb16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6fb expref: 19 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658430.054320:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a1eb24ba400) 00010000:00010000:1.0:1788658430.054323:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788658430.054325:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419800, rc 0) 00000100:00100000:1.0:1788658430.054394:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:10495:x1875544000980352:12345-192.168.202.53@tcp:101:rm.0 Request processed in 1085us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658430.054403:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:1.0:1788658430.060808:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658430.062004:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000980608 00000100:00100000:3.0:1788658430.062019:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000980608 00000100:00100000:2.0:1788658430.062181:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:2.0:1788658430.062210:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:10495:x1875544000980608:12345-192.168.202.53@tcp:36:rm.0 00010000:00010000:2.0:1788658430.062269:0:7958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788658430.062308:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6eb16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6fb expref: 19 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062333:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6eac2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6df expref: 18 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062349:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a1eb24ba400) 00010000:00010000:2.0:1788658430.062361:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6ead7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6e6 expref: 17 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062369:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1ec21e9b00) 00010000:00010000:2.0:1788658430.062372:0:7958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658430.062407:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6eb1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062459:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6eb1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062471:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6eb1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062484:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062491:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062498:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062639:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6eb2b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062648:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6eb2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.062655:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6eb2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658430.062930:0:7958:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788658430.062941:0:7958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347279237941ns, next at 348279235364ns, rc = 0 00010000:00010000:2.0:1788658430.062994:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063004:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063024:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063031:0:7958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063037:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063043:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063065:0:7958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658430.063086:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6eb2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063092:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6eb2b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063099:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6eb2b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063105:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658430.063109:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6eb2b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063117:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6eb2b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063126:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a1eb24ba400) 00010000:00010000:2.0:1788658430.063129:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788658430.063140:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6eb2b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063146:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6eb2b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063163:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6eb1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063170:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6eb1d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063175:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6eb1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063181:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658430.063183:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6eb1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063190:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6eb1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063198:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1ec21e9b00) 00010000:00010000:2.0:1788658430.063200:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658430.063203:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6eb1d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063209:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6eb1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658430.063219:0:7958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000489c79f4 reply state 000000008c0066dc transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063241:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.063248:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x71bb9c26 (ffff8a1ec21e9300) 00010000:00010000:2.0:1788658430.063250:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788658430.063253:0:7958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658430.063357:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:10495:x1875544000980608:12345-192.168.202.53@tcp:36:rm.0 Request processed in 1156us (2557us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788658430.063365:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00010000:00010000:2.0:1788658430.064486:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658430.064501:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.064510:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658430.064516:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.064526:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.064541:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a1eb24ba400) 00010000:00010000:2.0:1788658430.064544:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788658430.064549:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.064555:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6eb32 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658430.064568:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658430.064570:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658430.064665:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658430.068847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658430.069010:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000980864 00000100:00100000:1.0:1788658430.069020:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000980864 00000100:00100000:1.0:1788658430.069112:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:1.0:1788658430.069124:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:10495:x1875544000980864:12345-192.168.202.53@tcp:35:rm.0 00000100:00100000:1.0:1788658430.069504:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:10495:x1875544000980864:12345-192.168.202.53@tcp:35:rm.0 Request processed in 381us (668us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788658430.069513:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1788658430.072473:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658430.072611:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000981120 00000100:00100000:0.0:1788658430.072623:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000981120 00000100:00100000:0.0:1788658430.072686:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:0.0:1788658430.072698:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:10495:x1875544000981120:12345-192.168.202.53@tcp:36:rm.0 00010000:00010000:0.0:1788658430.072778:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788658430.072806:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eaf3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6f4 expref: 19 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.072830:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ea91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6d1 expref: 18 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.072842:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1ec21e9b00) 00010000:00010000:0.0:1788658430.072859:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6ea52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6c3 expref: 17 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.072868:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0600) 00010000:00010000:0.0:1788658430.072875:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658430.072914:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eb39 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.072942:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eb39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.072952:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eb39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.072965:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.072972:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.072979:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073064:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eb47 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073073:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eb47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073081:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eb47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658430.073329:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788658430.073346:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eb47 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073352:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eb47 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073358:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eb47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073369:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658430.073373:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eb47 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073381:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eb47 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073389:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8a1eb24ba300) 00010000:00010000:0.0:1788658430.073391:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788658430.073395:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eb47 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073401:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eb47 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073422:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eb39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073427:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eb39 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073433:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eb39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073437:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658430.073439:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eb39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073444:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eb39 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073463:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb24ba000) 00010000:00010000:0.0:1788658430.073465:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658430.073468:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eb39 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073474:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1c00/0x48e67cc629c6eb39 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658430.073486:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006397361c reply state 000000002b0621cd transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073497:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658430.073503:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a1eb24ba200) 00010000:00010000:0.0:1788658430.073505:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658430.073507:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658430.073583:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:10495:x1875544000981120:12345-192.168.202.53@tcp:36:rm.0 Request processed in 886us (1120us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788658430.073591:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:0.0:1788658430.398958:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658430.398984:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025184000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658430.399054:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658430.399133:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025184000 00000100:00100000:0.0:1788658430.399141:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025184000 00000100:00100000:0.0:1788658430.399193:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788658430.399203:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025184000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658430.399232:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658430.399285:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025184000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658430.399308:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00010000:3.0:1788658430.399311:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788658430.399351:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef4000 x1875544025184000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658430.399368:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025184000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658430.399519:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658430.399529:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025184128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658430.399562:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658430.399631:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025184128 00000100:00100000:1.0:1788658430.399636:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025184128 00000100:00100000:1.0:1788658430.399669:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788658430.399676:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025184128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658430.399688:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658430.399754:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025184128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658430.399760:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1788658430.399809:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3e300 x1875544025184128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658430.399822:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025184128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658430.913489:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025184256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658430.913575:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658430.914474:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025184256 00000100:00100000:2.0:1788658430.914485:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025184256 00000100:00100000:2.0:1788658430.914546:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788658430.914556:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025184256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658430.914592:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788658430.914667:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025184256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658430.914674:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788658430.916738:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025184256:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788658431.425180:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658432.204223:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658432.204270:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658432.204309:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658432.204328:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658432.204347:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658432.204377:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658432.204406:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000981504 00000100:00100000:1.0:1788658432.204416:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000981504 00000100:00100000:1.0:1788658432.204489:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000981760 00000100:00100000:1.0:1788658432.204494:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000981760 00000100:00100000:1.0:1788658432.204513:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000981376 00000100:00100000:1.0:1788658432.204516:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000981376 00000100:00100000:1.0:1788658432.204531:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000981888 00000100:00100000:1.0:1788658432.204533:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000981888 00000100:00100000:1.0:1788658432.204554:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 229 00000100:00100000:1.0:1788658432.204563:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000981504:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658432.204635:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000981504:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 72us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658432.204641:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 229 00000100:00100000:1.0:1788658432.204660:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 230 00000100:00100000:1.0:1788658432.204667:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000981760:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658432.204733:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000981760:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 66us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658432.204739:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 230 00000100:00100000:1.0:1788658432.204752:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 231 00000100:00100000:1.0:1788658432.204758:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:2397:x1875544000981376:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658432.204787:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:2397:x1875544000981376:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658432.204800:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 231 00000100:00100000:1.0:1788658432.204812:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 232 00000100:00100000:1.0:1788658432.204818:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000981888:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658432.204841:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000981888:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658432.204847:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 232 00000100:00100000:1.0:1788658432.205885:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000981632 00000100:00100000:1.0:1788658432.205896:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000981632 00000100:00100000:1.0:1788658432.205942:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00100000:1.0:1788658432.205952:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000981632:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658432.206011:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000981632:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 62us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658432.206018:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00080000:1.0:1788658432.207774:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658432.207783:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658432.207786:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000981248 00000100:00080000:1.0:1788658432.207788:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658432.207797:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000981248 00000100:00100000:2.0:1788658432.207867:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 338 00000100:00100000:2.0:1788658432.207878:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000981248:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658432.207937:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000981248:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 61us (3724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658432.207944:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 338 00010000:00010000:2.0:1788658432.446953:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658433.470889:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658433.471479:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025184384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658433.471545:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658433.471611:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025184384 00000100:00100000:1.0:1788658433.471618:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025184384 00000100:00100000:1.0:1788658433.471659:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788658433.471667:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025184384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658433.471699:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788658433.471767:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025184384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658433.471793:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788658433.471856:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025184384:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788658434.023559:0:13699:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788658434.495338:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788658435.007861:0:9972:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352224155423ns, next at 353224153057ns, rc = 0 00000100:00100000:1.0:1788658435.007869:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025184512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658435.007940:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658435.008003:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025184640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658435.008025:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658435.008062:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025184512 00000100:00100000:1.0:1788658435.008069:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025184512 00000100:00100000:1.0:1788658435.008110:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025184640 00000100:00100000:1.0:1788658435.008113:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025184640 00000100:00100000:1.0:1788658435.008129:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788658435.008138:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025184512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658435.008166:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658435.008221:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025184512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658435.008229:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788658435.008246:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788658435.008252:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025184640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658435.008262:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1788658435.008270:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c79c00 x1875544025184512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658435.008283:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025184640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658435.008288:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788658435.008289:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025184512:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788658435.008301:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377fb80 x1875544025184640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788658435.008303:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658435.008318:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025184640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658435.008916:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025184768:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.008956:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658435.008992:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025185280:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.009017:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658435.009119:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025184768 00000100:00100000:2.0:1788658435.009125:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025184768 00000100:00100000:2.0:1788658435.009159:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788658435.009167:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025184768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.009206:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025184768:12345-0@lo:400:kworker.0 Request processed in 41us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.009214:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788658435.009282:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025185792:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.009310:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658435.009383:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025184768:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.009396:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788658435.009403:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025185152:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.009430:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658435.009452:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025185664:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.009474:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658435.010919:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025185792 00000100:00100000:2.0:1788658435.010931:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025185792 00000100:00100000:2.0:1788658435.010985:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025185664 00000100:00100000:2.0:1788658435.010989:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025185664 00000100:00100000:2.0:1788658435.011014:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788658435.011022:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025185792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.011207:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025184896:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.011259:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658435.011281:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025185408:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.011319:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658435.011339:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025185920:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.011360:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658435.011382:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788658435.011388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025185024:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.011413:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658435.011551:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025185792:12345-0@lo:400:kworker.0 Request processed in 529us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.011559:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788658435.011577:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788658435.011584:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025185664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.011948:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025185664:12345-0@lo:400:kworker.0 Request processed in 364us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.011955:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788658435.011980:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788658435.012263:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d836ce680 x1875544025185664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658435.012290:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025185664:0@lo:400:kworker.0 00010000:00080000:2.0:1788658435.012306:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d836cfb80 x1875544025185792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658435.012316:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025185792:0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.012870:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025185152 00000100:00100000:2.0:1788658435.012879:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025185152 00000100:00100000:2.0:1788658435.012919:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025184896 00000100:00100000:2.0:1788658435.012923:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025184896 00000100:00100000:2.0:1788658435.012935:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025185408 00000100:00100000:2.0:1788658435.012938:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025185408 00000100:00100000:2.0:1788658435.012957:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025185920 00000100:00100000:2.0:1788658435.012960:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025185920 00000100:00100000:2.0:1788658435.012980:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788658435.012988:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025185152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.013059:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025185152:12345-0@lo:400:kworker.0 Request processed in 73us (3628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.013067:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788658435.013081:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788658435.013087:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025184896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.013118:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025184896:12345-0@lo:400:kworker.0 Request processed in 31us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.013124:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788658435.013135:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788658435.013141:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025185408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.013169:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025185408:12345-0@lo:400:kworker.0 Request processed in 28us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.013182:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788658435.013194:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788658435.013199:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025185920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.013231:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025185920:12345-0@lo:400:kworker.0 Request processed in 32us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.013236:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:2.0:1788658435.013324:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658435.013440:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025185152:0@lo:400:kworker.0 00000004:00080000:2.0:1788658435.016336:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788658435.016387:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788658435.016399:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788658435.016434:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016446:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016453:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016459:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658435.016463:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016471:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016490:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x71bb9c26 (ffff8a1ec21e9300) 00010000:00010000:2.0:1788658435.016499:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658435.016504:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016510:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6eaa6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016534:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016539:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016545:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016549:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658435.016551:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016556:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016562:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8a1eb24ba400) 00010000:00010000:2.0:1788658435.016564:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658435.016567:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016571:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eabb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016589:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016615:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016621:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016626:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658435.016629:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016636:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016645:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x71bb9c26 (ffff8a1ec21e9300) 00010000:00010000:2.0:1788658435.016647:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658435.016650:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016656:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6eb24 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x71bb9c26 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016672:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016679:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016685:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.016689:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658435.016699:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.017106:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.017115:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a1eb24ba200) 00010000:00010000:2.0:1788658435.017118:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658435.017121:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.017126:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0200/0x48e67cc629c6eb40 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658435.017988:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658435.018007:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025186176:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788658435.018200:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658435.018471:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025186176 00000100:00100000:3.0:1788658435.018480:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025186176 00000100:00100000:3.0:1788658435.018532:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788658435.018541:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025186176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788658435.018583:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1788658435.018630:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9cc2fd, atime: 0x6a9cc2fd, ctime: 0x6a9cc2fd, blocks: 0x0 00010000:00010000:3.0:1788658435.018641:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088529bfa/0x48e67cc629c6eb4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.018657:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1788658435.018662:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658435.018668:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088529bfa/0x48e67cc629c6eb4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.018686:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088529bfa/0x48e67cc629c6eb4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.018697:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088529bfa/0x48e67cc629c6eb4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.018731:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088529bfa/0x48e67cc629c6eb4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.018758:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788658435.018913:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025186176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 373us (712us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788658435.018921:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788658435.021022:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658435.021219:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088529bfa/0x48e67cc629c6eb4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.021233:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658435.021238:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088529bfa/0x48e67cc629c6eb4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.021250:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088529bfa/0x48e67cc629c6eb4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.021278:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088529bfa/0x48e67cc629c6eb4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.021300:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088529bfa/0x48e67cc629c6eb4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.021806:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658435.021809:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658435.021811:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788658435.021871:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1eb377fb80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788658435.022443:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025186176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788658435.023258:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025185536:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.023315:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658435.023347:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025186048:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.023371:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658435.023395:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025185536 00000100:00100000:0.0:1788658435.023403:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025185536 00000100:00100000:0.0:1788658435.023458:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025186048 00000100:00100000:0.0:1788658435.023461:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025186048 00000100:00100000:0.0:1788658435.023486:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788658435.023494:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025185536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.023542:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025185536:12345-0@lo:400:kworker.0 Request processed in 49us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658435.023548:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788658435.023566:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788658435.023572:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025186048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.023596:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025186048:12345-0@lo:400:kworker.0 Request processed in 24us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658435.023603:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00080000:0.0:1788658435.023621:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788658435.023643:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d836cdc00 x1875544025186048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658435.023671:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025186048:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.023690:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025184896:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.023732:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025185408:0@lo:400:kworker.0 00000100:00100000:0.0:1788658435.023759:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025185920:0@lo:400:kworker.0 00010000:00080000:0.0:1788658435.023796:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d836cc700 x1875544025185536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658435.023805:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025185536:0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.027280:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025185024 00000100:00100000:1.0:1788658435.027280:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025185280 00000100:00100000:2.0:1788658435.027296:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025185024 00000100:00100000:1.0:1788658435.027296:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025185280 00000100:00100000:2.0:1788658435.027421:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788658435.027433:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025185024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.027583:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025185024:12345-0@lo:400:kworker.0 Request processed in 152us (16168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.027591:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788658435.027607:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788658435.027614:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025185280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.027652:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025185280:12345-0@lo:400:kworker.0 Request processed in 38us (18633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.027658:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788658435.027755:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025185024:0@lo:400:kworker.0 00000100:00100000:2.0:1788658435.028241:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025185280:0@lo:400:kworker.0 00000020:00000080:0.0:1788658435.216949:0:13747:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb2612b30 20000000:00000080:0.0:1788658435.216968:0:13747:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1d83cd5c00 uarg=0000000000000000 20000000:01000000:0.0:1788658435.217025:0:13747:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788658435.217031:0:13747:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788658435.217037:0:13747:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788658435.217514:0:13748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788658435.217683:0:13747:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788658435.221314:0:13747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788658435.221344:0:13747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788658435.221357:0:13747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788658435.221371:0:13747:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788658435.221390:0:13747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221408:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6e9db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ae expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221417:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1d834a0a00/0x48e67cc629c6e9e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6b5 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221444:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c6e9f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e9e9 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221451:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb23b2800/0x48e67cc629c6e9fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6e9f7 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221457:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6ea0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6ea05 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221464:0:13747:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ea1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6ea13 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221471:0:13747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221508:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ea1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6ea13 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221521:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ea1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6ea13 expref: 23 pid: 6530 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658435.221534:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186304:0@lo:104: 00000100:00100000:0.0:1788658435.221595:0:13747:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658435.221691:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6ea0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6ea05 expref: 23 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221699:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6ea0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6ea05 expref: 23 pid: 6530 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658435.221754:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186432:0@lo:104: 00010000:00010000:0.0:1788658435.221785:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb23b2800/0x48e67cc629c6e9fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e9f7 expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221792:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1eb23b2800/0x48e67cc629c6e9fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e9f7 expref: 23 pid: 6529 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658435.221800:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186560:0@lo:104: 00010000:00010000:0.0:1788658435.221817:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c6e9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6e9e9 expref: 23 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221824:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c6e9f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6e9e9 expref: 23 pid: 6531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658435.221831:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186688:0@lo:104: 00010000:00010000:0.0:1788658435.221850:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1d834a0a00/0x48e67cc629c6e9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6b5 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221858:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1d834a0a00/0x48e67cc629c6e9e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6b5 expref: 12 pid: 6531 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658435.221866:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186816:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658435.221918:0:13747:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6e9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ae expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658435.221926:0:13747:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6e9db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ae expref: 12 pid: 6531 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658435.221934:0:13747:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186944:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658435.221963:0:13747:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658435.225644:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186816:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658435.225657:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186944:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658435.226216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658435.226451:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000982016 00000100:00100000:2.0:1788658435.226459:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000982016 00010000:00010000:2.0:1788658435.226496:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1d834a0a00/0x48e67cc629c6e9e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6b5 expref: 13 pid: 6531 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658435.226547:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:2.0:1788658435.226555:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000982016:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658435.226569:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658435.226574:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1d834a0a00/0x48e67cc629c6e9e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6b5 expref: 13 pid: 6531 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.226586:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1d834a0a00/0x48e67cc629c6e9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6b5 expref: 13 pid: 6531 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.226603:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d834a0a00/0x48e67cc629c6e9e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6b5 expref: 13 pid: 6531 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658435.226624:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658435.226675:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:552b02cf-e822-4974-bfd4-4217116bc45f+12:2397:x1875544000982016:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 120us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.226684:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:0.0:1788658435.226791:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658435.227253:0:6520:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788658435.227279:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658435.227312:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658435.227324:0:6520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658435.227332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025186304 00000100:00100000:1.0:1788658435.227337:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025186304 00000100:00100000:1.0:1788658435.227361:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025186432 00000100:00100000:1.0:1788658435.227364:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025186432 00000100:00100000:1.0:1788658435.227372:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025186560 00000100:00100000:1.0:1788658435.227375:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025186560 00000100:00100000:1.0:1788658435.227383:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025186688 00000100:00100000:1.0:1788658435.227386:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025186688 00000100:00100000:1.0:1788658435.227396:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658435.227403:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd918050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:13747:x1875544025186304:12345-0@lo:104: 00010000:00010000:1.0:1788658435.227415:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227467:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658435.227472:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd918050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+6:13747:x1875544025186304:12345-0@lo:104: Request processed in 71us (5877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658435.227478:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658435.227527:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788658435.227533:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:13747:x1875544025186432:12345-0@lo:104: 00010000:00010000:1.0:1788658435.227540:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227573:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788658435.227579:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+5:13747:x1875544025186432:12345-0@lo:104: Request processed in 46us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658435.227584:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788658435.227606:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658435.227623:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:13747:x1875544025186560:12345-0@lo:104: 00010000:00010000:1.0:1788658435.227631:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227662:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788658435.227667:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+4:13747:x1875544025186560:12345-0@lo:104: Request processed in 45us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658435.227673:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658435.227683:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788658435.227689:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:13747:x1875544025186688:12345-0@lo:104: 00010000:00010000:1.0:1788658435.227696:0:6520:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227750:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788658435.227756:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+3:13747:x1875544025186688:12345-0@lo:104: Request processed in 67us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658435.227761:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1788658435.227777:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788658435.227784:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227791:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2c00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658435.227795:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227804:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658435.227821:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658435.227827:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788658435.227861:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227867:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658435.227884:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227891:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2c00/0x48e67cc629c6ea13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6ea1a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227903:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788658435.227906:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227911:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2600 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658435.227913:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227919:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658435.227924:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658435.227929:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788658435.227946:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227951:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658435.227964:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227971:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2600/0x48e67cc629c6ea05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6ea0c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227980:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658435.227982:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.227987:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658435.227990:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.228010:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658435.228017:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658435.228022:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788658435.228035:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.228040:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658435.228045:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.228061:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6e9f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e9fe expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.228069:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658435.228072:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.228078:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2e00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658435.228081:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.228088:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658435.228094:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658435.228099:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788658435.228112:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.228118:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658435.228123:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.228129:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2e00/0x48e67cc629c6e9e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6e9f0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.228142:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658435.228149:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658435.228151:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658435.228157:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658435.228364:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186304:0@lo:104: 00000100:00100000:0.0:1788658435.228373:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186432:0@lo:104: 00000100:00100000:0.0:1788658435.228381:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186560:0@lo:104: 00000100:00100000:0.0:1788658435.228389:0:13747:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13747:1875544025186688:0@lo:104: 00010000:00010000:0.0:1788658435.228422:0:13747:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658435.228507:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000982144 00000100:00100000:3.0:1788658435.228518:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000982144 00010000:00010000:3.0:1788658435.228541:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6e9db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ae expref: 12 pid: 6531 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658435.228572:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:3.0:1788658435.228580:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:552b02cf-e822-4974-bfd4-4217116bc45f+12:2397:x1875544000982144:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658435.228590:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658435.228595:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6e9db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ae expref: 12 pid: 6531 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.228662:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6e9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ae expref: 12 pid: 6531 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.228679:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6e9db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc6ae expref: 12 pid: 6531 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.228692:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658435.228769:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:552b02cf-e822-4974-bfd4-4217116bc45f+11:2397:x1875544000982144:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 189us (1977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658435.228777:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:3.0:1788658435.228806:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025187456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658435.228845:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658435.228883:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658435.228889:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025187072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658435.228911:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658435.228933:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025187200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658435.228954:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658435.228982:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658435.228987:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025187328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658435.229140:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658435.229159:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025187456 00000100:00100000:3.0:1788658435.229164:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025187456 00010000:00010000:3.0:1788658435.229180:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c6e9f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e9e9 expref: 24 pid: 6531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658435.229193:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025187072 00000100:00100000:3.0:1788658435.229195:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025187072 00010000:00010000:3.0:1788658435.229205:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ea1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6ea13 expref: 25 pid: 6530 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658435.229215:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025187200 00000100:00100000:3.0:1788658435.229217:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025187200 00010000:00010000:3.0:1788658435.229226:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6ea0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6ea05 expref: 26 pid: 6530 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658435.229235:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025187328 00000100:00100000:3.0:1788658435.229238:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025187328 00010000:00010000:3.0:1788658435.229247:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb23b2800/0x48e67cc629c6e9fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e9f7 expref: 27 pid: 6529 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658435.229257:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658435.229263:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+27:3649:x1875544025187456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658435.229273:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658435.229277:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c6e9f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e9e9 expref: 27 pid: 6531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229285:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c6e9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e9e9 expref: 27 pid: 6531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229305:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96a00/0x48e67cc629c6e9f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e9e9 expref: 27 pid: 6531 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229314:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658435.229389:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+26:3649:x1875544025187456:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658435.229396:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658435.229409:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788658435.229414:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+25:3649:x1875544025187072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658435.229422:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658435.229426:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ea1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6ea13 expref: 25 pid: 6530 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229435:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ea1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6ea13 expref: 25 pid: 6530 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229445:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ea1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6ea13 expref: 25 pid: 6530 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229453:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658435.229472:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025187072:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658435.229478:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788658435.229488:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788658435.229493:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:3647:x1875544025187200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658435.229500:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658435.229504:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6ea0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6ea05 expref: 23 pid: 6530 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229516:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6ea0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6ea05 expref: 23 pid: 6530 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229526:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6ea0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6ea05 expref: 23 pid: 6530 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229534:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658435.229559:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:3647:x1875544025187200:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658435.229565:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788658435.229577:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788658435.229583:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:3647:x1875544025187328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658435.229590:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658435.229594:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb23b2800/0x48e67cc629c6e9fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6e9f7 expref: 21 pid: 6529 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229602:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb23b2800/0x48e67cc629c6e9fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6e9f7 expref: 21 pid: 6529 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229688:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b2800/0x48e67cc629c6e9fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6e9f7 expref: 21 pid: 6529 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229759:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229768:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229782:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229794:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229802:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229809:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229815:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658435.229819:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229826:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229840:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658435.229850:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658435.229874:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:3647:x1875544025187328:12345-0@lo:103:ldlm_bl.0 Request processed in 291us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658435.229880:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788658435.229912:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025187328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658435.229920:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025187200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658435.230195:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658435.230802:0:13747:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.230813:0:13747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658435.230820:0:13747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb55 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658435.247676:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025187456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658435.247744:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025187072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658435.518942:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025187584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658435.519152:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658435.519255:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658435.519294:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025187584 00000100:00100000:2.0:1788658435.519301:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025187584 00000100:00100000:2.0:1788658435.519384:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788658435.519394:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025187584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788658435.519424:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658435.519490:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025187584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658435.519498:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:3.0:1788658435.519586:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c78380 x1875544025187584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658435.519606:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025187584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658435.526471:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025187712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658435.526549:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658435.526662:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025187712 00000100:00100000:1.0:1788658435.526671:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025187712 00000100:00100000:1.0:1788658435.526776:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788658435.526787:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025187712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658435.526808:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658435.526851:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025187712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658435.526858:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:3.0:1788658435.530365:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c7b800 x1875544025187712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658435.530395:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025187712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658436.042893:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025187840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658436.042977:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658436.043521:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025187840 00000100:00100000:1.0:1788658436.043530:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025187840 00000100:00100000:1.0:1788658436.043587:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788658436.043597:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025187840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788658436.043641:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788658436.043689:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025187840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.043723:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788658436.044912:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025187840:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1788658436.192666:0:13796:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5b845a50 20000000:00000080:3.0:1788658436.192684:0:13796:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1d83457400 uarg=0000000000000000 20000000:01000000:3.0:1788658436.192845:0:13796:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788658436.192852:0:13796:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788658436.192857:0:13796:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1788658436.193506:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788658436.193678:0:13796:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788658436.193891:0:13796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788658436.193920:0:13796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788658436.193935:0:13796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788658436.193947:0:13796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788658436.193967:0:13796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.193984:0:13796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.193996:0:13796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.194003:0:13796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.194010:0:13796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.194029:0:13796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.194035:0:13796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658436.194040:0:13796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.194049:0:13796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.194063:0:13796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.194071:0:13796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.194077:0:13796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eb5c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.543507:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658436.549488:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658436.553418:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000982272 00000100:00100000:2.0:1788658436.553505:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000982272 00000100:00100000:2.0:1788658436.553642:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 340 00000100:00100000:2.0:1788658436.553654:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+11:6171:x1875544000982272:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658436.553670:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658436.553690:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a0800/0x48e67cc629c6eb63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc702 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658436.553736:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a0800/0x48e67cc629c6eb63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc702 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658436.553749:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a0800/0x48e67cc629c6eb63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc702 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658436.553758:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0800, rc 0) 00000100:00100000:2.0:1788658436.553833:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000982272:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 180us (4420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658436.553840:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 340 00000100:00100000:3.0:1788658436.556617:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658436.566740:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000982400 00000100:00100000:0.0:1788658436.566760:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000982400 00000100:00100000:0.0:1788658436.566828:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 341 00000100:00100000:0.0:1788658436.566839:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000982400:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.567015:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000982400:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 177us (10407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.567024:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 341 00000100:00100000:1.0:1788658436.569540:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658436.569606:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000982528 00000100:00100000:0.0:1788658436.569616:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000982528 00000100:00100000:0.0:1788658436.569661:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 342 00000100:00100000:0.0:1788658436.569677:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000982528:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.569825:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000982528:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 147us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.569833:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 342 00000100:00100000:3.0:1788658436.580236:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658436.580484:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000982656 00000100:00100000:1.0:1788658436.580495:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000982656 00000100:00100000:1.0:1788658436.580613:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 343 00000100:00100000:1.0:1788658436.580624:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+12:10780:x1875544000982656:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658436.580817:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+12:10780:x1875544000982656:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 194us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.580825:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 343 00000100:00100000:3.0:1788658436.585031:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658436.585174:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000982784 00000100:00100000:2.0:1788658436.585184:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000982784 00000100:00100000:2.0:1788658436.585246:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 344 00000100:00100000:2.0:1788658436.585257:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+12:10780:x1875544000982784:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658436.585412:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+12:10780:x1875544000982784:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 156us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658436.585440:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 344 00000100:00100000:2.0:1788658436.592380:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658436.592700:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000982912 00000100:00100000:1.0:1788658436.592761:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000982912 00000100:00100000:1.0:1788658436.592827:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 345 00000100:00100000:1.0:1788658436.592839:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+12:6171:x1875544000982912:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658436.592868:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658436.592890:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83418400/0x48e67cc629c6eb6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc709 expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658436.592920:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83418400/0x48e67cc629c6eb6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc709 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658436.592932:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83418400/0x48e67cc629c6eb6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc709 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658436.592942:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418400, rc 0) 00000100:00100000:1.0:1788658436.593018:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:6171:x1875544000982912:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 180us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.593047:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 345 00000100:00100000:3.0:1788658436.595643:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658436.595834:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000983040 00000100:00100000:0.0:1788658436.595843:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000983040 00000100:00100000:0.0:1788658436.595958:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 346 00000100:00100000:0.0:1788658436.595967:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:6171:x1875544000983040:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.596295:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:6171:x1875544000983040:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 328us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.596303:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 346 00000100:00100000:3.0:1788658436.603111:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658436.603484:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000983168 00000100:00100000:2.0:1788658436.603494:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000983168 00000100:00100000:2.0:1788658436.603569:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 347 00000100:00100000:2.0:1788658436.603580:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:6171:x1875544000983168:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658436.603745:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:6171:x1875544000983168:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 165us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658436.603754:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 347 00000100:00100000:2.0:1788658436.608869:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658436.609202:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000983296 00000100:00100000:0.0:1788658436.609212:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000983296 00000100:00100000:0.0:1788658436.609269:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 348 00000100:00100000:0.0:1788658436.609280:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:10783:x1875544000983296:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658436.609444:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:10783:x1875544000983296:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 164us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.609452:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 348 00000100:00100000:3.0:1788658436.617352:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658436.617479:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000983424 00000100:00100000:1.0:1788658436.617491:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000983424 00000100:00100000:1.0:1788658436.617555:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 349 00000100:00100000:1.0:1788658436.617574:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:10783:x1875544000983424:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658436.617773:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:10783:x1875544000983424:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 199us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.617780:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 349 10000000:01000000:1.0:1788658436.735133:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788658436.735141:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1d8230c000 from 7 10000000:01000000:1.0:1788658436.735145:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658436.735188:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658436.735197:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658436.735206:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658436.735226:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025187968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658436.735283:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658436.735404:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834c2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658436.736761:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025187968 00000100:00100000:2.0:1788658436.736773:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025187968 00000100:00100000:2.0:1788658436.736839:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788658436.736849:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:6534:x1875544025187968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658436.736865:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658436.736882:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a1c00/0x48e67cc629c6eb78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6eb71 expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658436.736908:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a1c00/0x48e67cc629c6eb78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6eb71 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658436.736920:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a1c00/0x48e67cc629c6eb78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6eb71 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658436.736929:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1c00, rc 0) 00000100:00100000:2.0:1788658436.736995:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025187968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658436.737026:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788658436.737820:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025187968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658436.737841:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.737852:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658436.737950:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025188096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.737988:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658436.738034:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658436.738048:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025188096 00000100:00100000:2.0:1788658436.738054:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025188096 00000100:00100000:2.0:1788658436.738100:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788658436.738110:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025188096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658436.738243:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025188096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658436.738250:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788658436.739281:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025188096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.739319:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025188224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.739505:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658436.739623:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658436.739903:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025188224 00000100:00100000:1.0:1788658436.739910:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025188224 00000100:00100000:1.0:1788658436.739994:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788658436.740003:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025188224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658436.740134:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025188224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.740142:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788658436.740269:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025188224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658436.740926:0:13809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13809:1875544025188352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658436.740968:0:13809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658436.741310:0:13809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658436.741504:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025188352 00000100:00100000:0.0:1788658436.741511:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025188352 00000100:00100000:0.0:1788658436.741541:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788658436.741560:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:13809:x1875544025188352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658436.741672:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:13809:x1875544025188352:12345-0@lo:502:llog_process_th.0 Request processed in 113us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.741679:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788658436.741854:0:13809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13809:1875544025188352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658436.741883:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658436.741893:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658436.741895:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788658436.741903:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1d8230c000 00000020:00000080:2.0:1788658436.741906:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788658436.741972:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658436.741976:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658436.741977:0:13809:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788658436.741980:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658436.741982:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658436.741984:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788658436.741987:0:13809:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1d8230c000 00000020:00000080:2.0:1788658436.741989:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788658436.742032:0:13809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13809:1875544025188480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658436.742068:0:13809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658436.742089:0:13809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658436.744295:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025188480 00000100:00100000:0.0:1788658436.744307:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025188480 00000100:00100000:0.0:1788658436.744477:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788658436.744488:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:13809:x1875544025188480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658436.744639:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:13809:x1875544025188480:12345-0@lo:502:llog_process_th.0 Request processed in 153us (2569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.744646:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788658436.747870:0:13809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13809:1875544025188480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658436.747921:0:13809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658436.747932:0:13809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658436.747935:0:13809:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788658436.747941:0:13809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788658436.752509:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788658436.752565:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658436.752577:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.752972:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658436.752984:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658436.752987:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ebd8b1800 from 7 10000000:01000000:0.0:1788658436.752990:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658436.753026:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.753034:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.753045:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658436.753072:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025188608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.753427:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658436.753533:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658436.762045:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025188608 00000100:00100000:1.0:1788658436.762060:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025188608 00000100:00100000:1.0:1788658436.762311:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788658436.762323:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+21:6534:x1875544025188608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658436.762341:0:6531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658436.762361:0:6531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83419000/0x48e67cc629c6eb86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6eb7f expref: -99 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658436.762393:0:6531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83419000/0x48e67cc629c6eb86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6eb7f expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658436.762405:0:6531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83419000/0x48e67cc629c6eb86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6eb7f expref: 22 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658436.762413:0:6531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419000, rc 0) 00000100:00100000:1.0:1788658436.762490:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025188608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (9063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.762497:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788658436.762746:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025188608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658436.762765:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.762776:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658436.762854:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025188736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.762888:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658436.766077:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658436.767210:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025188736 00000100:00100000:3.0:1788658436.767223:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025188736 00000100:00100000:3.0:1788658436.767281:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788658436.767299:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025188736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658436.767463:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025188736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (4574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658436.767472:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788658436.767529:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025188736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658436.767605:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025188864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658436.771057:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658436.771277:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658436.771309:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025188864 00000100:00100000:3.0:1788658436.771317:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025188864 00000100:00100000:3.0:1788658436.771359:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788658436.771369:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025188864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658436.771500:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025188864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658436.771507:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788658436.771573:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025188864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658436.774951:0:13812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13812:1875544025188992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658436.775027:0:13812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658436.775417:0:13812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658436.782925:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025188992 00000100:00100000:0.0:1788658436.782940:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025188992 00000100:00100000:3.0:1788658436.786011:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788658436.786025:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:13812:x1875544025188992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658436.786214:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:13812:x1875544025188992:12345-0@lo:502:llog_process_th.0 Request processed in 191us (11185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658436.786221:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788658436.786469:0:13812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13812:1875544025188992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788658436.786507:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658436.786518:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658436.786520:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788658436.786529:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1ebd8b1800 00000020:00000080:0.0:1788658436.786531:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788658436.786599:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658436.788071:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658436.788077:0:13812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788658436.788089:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658436.788094:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658436.788096:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788658436.788102:0:13812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1ebd8b1800 00000020:00000080:0.0:1788658436.788105:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788658436.788963:0:13812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13812:1875544025189120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658436.789040:0:13812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658436.789076:0:13812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658436.789106:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025189120 00000100:00100000:1.0:1788658436.789113:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025189120 00000100:00100000:1.0:1788658436.789156:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788658436.789164:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:13812:x1875544025189120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658436.789280:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:13812:x1875544025189120:12345-0@lo:502:llog_process_th.0 Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.789288:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788658436.789340:0:13812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13812:1875544025189120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658436.789365:0:13812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658436.789370:0:13812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658436.789373:0:13812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788658436.789376:0:13812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788658436.789749:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788658436.789773:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658436.789783:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658436.789809:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658436.789821:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658436.789825:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ec11f4800 from 7 10000000:01000000:2.0:1788658436.789827:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658436.789852:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658436.789861:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658436.789869:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658436.789885:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025189248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658436.789915:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658436.789950:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658436.790007:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025189248 00000100:00100000:0.0:1788658436.790013:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025189248 00000100:00100000:0.0:1788658436.790050:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788658436.790058:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:6534:x1875544025189248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658436.790067:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658436.790078:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6eb8d expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.790099:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6eb8d expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.790109:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6eb8d expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.790128:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1c00, rc 0) 00000100:00100000:0.0:1788658436.790164:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025189248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.790170:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788658436.790206:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025189248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658436.790219:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.790229:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658436.790295:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025189376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.790319:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658436.790352:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d835049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658436.790364:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025189376 00000100:00100000:0.0:1788658436.790367:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025189376 00000100:00100000:0.0:1788658436.790384:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788658436.790389:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025189376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.790479:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025189376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.790486:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788658436.790515:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025189376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.790557:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025189504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.790592:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658436.790611:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d835049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658436.790623:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025189504 00000100:00100000:0.0:1788658436.790626:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025189504 00000100:00100000:0.0:1788658436.790643:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788658436.790649:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025189504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.790741:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025189504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.790749:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788658436.790786:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025189504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658436.793527:0:13814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13814:1875544025189632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658436.793881:0:13814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658436.793916:0:13814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834c20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658436.793975:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025189632 00000100:00100000:0.0:1788658436.793983:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025189632 00000100:00100000:0.0:1788658436.794035:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788658436.794044:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:13814:x1875544025189632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658436.794155:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:13814:x1875544025189632:12345-0@lo:502:llog_process_th.0 Request processed in 111us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.794163:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788658436.794248:0:13814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13814:1875544025189632:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658436.794274:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658436.794282:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658436.794285:0:13814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658436.794290:0:13814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1ec11f4800 00000020:00000080:1.0:1788658436.794293:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658436.794344:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658436.794347:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658436.794349:0:13814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658436.794351:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658436.794354:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658436.794355:0:13814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788658436.794358:0:13814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1ec11f4800 00000020:00000080:1.0:1788658436.794360:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788658436.794390:0:13814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13814:1875544025189760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658436.794419:0:13814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658436.794443:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025189760 00000100:00100000:1.0:1788658436.794447:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025189760 00000100:00100000:1.0:1788658436.794466:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788658436.794472:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:13814:x1875544025189760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658436.794524:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:13814:x1875544025189760:12345-0@lo:502:llog_process_th.0 Request processed in 51us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.794531:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788658436.794573:0:13814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d834c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658436.794583:0:13814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c7a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13814:1875544025189760:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788658436.794630:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:1.0:1788658436.796157:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658436.796168:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658436.796171:0:13814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788658436.796176:0:13814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788658436.796521:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788658436.796554:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658436.796565:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.796576:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658436.796587:0:6534:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658436.796860:0:6534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1ec1212800 from 7 10000000:01000000:0.0:1788658436.796863:0:6534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658436.796896:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.796911:0:6534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.796921:0:6534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658436.796942:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025189888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.796996:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658436.797071:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658436.800453:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025189888 00000100:00100000:1.0:1788658436.800466:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025189888 00000100:00100000:3.0:1788658436.806261:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788658436.806277:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:6534:x1875544025189888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658436.806296:0:6529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658436.806315:0:6529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eba2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6eb9b expref: -99 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.806485:0:6529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6eb9b expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.806499:0:6529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6eb9b expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658436.806509:0:6529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80030a00, rc 0) 00000100:00100000:3.0:1788658436.806615:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025189888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 342us (9617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658436.806622:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788658436.812308:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025189888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658436.812352:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.812366:0:6534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658436.812570:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025190016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.812636:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658436.819525:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658436.819741:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025190016 00000100:00100000:1.0:1788658436.819752:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025190016 00000100:00100000:1.0:1788658436.819835:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788658436.819846:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025190016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658436.820001:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025190016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (7364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.820010:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788658436.822587:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025190016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658436.822661:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025190144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658436.822763:0:6534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658436.823198:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788658436.823252:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025190144 00000100:00100000:0.0:1788658436.823260:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025190144 00000100:00100000:0.0:1788658436.823314:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788658436.823323:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025190144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658436.823593:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:6534:x1875544025190144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 270us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658436.823602:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788658436.824882:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a017dcfd-fba9-49c7-bb83-f753e9511c6f:6534:1875544025190144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788658436.825941:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788658436.836198:0:13817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13817:1875544025190272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658436.836282:0:13817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658436.836326:0:13817:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658436.836956:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025190272 00000100:00100000:1.0:1788658436.836965:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025190272 00000100:00100000:1.0:1788658436.837019:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788658436.837029:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:13817:x1875544025190272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658436.837163:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:13817:x1875544025190272:12345-0@lo:502:llog_process_th.0 Request processed in 134us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.837176:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788658436.837257:0:13817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13817:1875544025190272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788658436.837294:0:13817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658436.837305:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658436.837308:0:13817:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788658436.837315:0:13817:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1ec1212800 00000020:00000080:3.0:1788658436.837318:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788658436.837395:0:13817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658436.837399:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658436.837400:0:13817:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788658436.837402:0:13817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658436.837404:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658436.837406:0:13817:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788658436.837409:0:13817:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1ec1212800 00000020:00000080:3.0:1788658436.837417:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788658436.837458:0:13817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13817:1875544025190400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658436.837498:0:13817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658436.837541:0:13817:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658436.838013:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025190400 00000100:00100000:1.0:1788658436.838019:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025190400 00000100:00100000:1.0:1788658436.838060:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788658436.838068:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:13817:x1875544025190400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658436.838161:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:13817:x1875544025190400:12345-0@lo:502:llog_process_th.0 Request processed in 93us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658436.838169:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788658436.838763:0:13817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a017dcfd-fba9-49c7-bb83-f753e9511c6f:13817:1875544025190400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788658436.838807:0:13817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658436.838814:0:13817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658436.838816:0:13817:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788658436.838820:0:13817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788658436.838996:0:6534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788658436.839022:0:6534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658436.839032:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658436.839047:0:6534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658437.307177:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658437.307226:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658437.307473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658437.307515:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658437.307535:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658437.307560:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658437.307590:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000983936 00000100:00100000:3.0:1788658437.307599:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000983936 00000100:00100000:3.0:1788658437.307654:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:3.0:1788658437.307664:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000983936:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658437.307905:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000983808 00000100:00100000:2.0:1788658437.307910:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000983808 00000100:00100000:2.0:1788658437.307944:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000984064 00000100:00100000:2.0:1788658437.307946:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000984064 00000100:00100000:2.0:1788658437.307976:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000983680 00000100:00100000:2.0:1788658437.307978:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000983680 00000100:00100000:2.0:1788658437.307990:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000984192 00000100:00100000:2.0:1788658437.307992:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000984192 00000100:00100000:2.0:1788658437.308006:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 239 00000100:00100000:2.0:1788658437.308012:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000983808:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658437.308084:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000983552 00000100:00100000:1.0:1788658437.308089:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000983552 00000100:00100000:1.0:1788658437.308118:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 370 00000100:00100000:1.0:1788658437.308125:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000983552:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658437.308183:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000983936:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 520us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658437.308190:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:3.0:1788658437.308215:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 240 00000100:00100000:3.0:1788658437.308222:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000984064:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658437.310169:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 241 00000100:00100000:0.0:1788658437.310189:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000983680:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658437.318780:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000983808:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 10748us (11533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658437.318795:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 239 00000100:00100000:2.0:1788658437.318838:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 242 00000100:00100000:2.0:1788658437.318853:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000984192:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658437.318905:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000984192:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 59us (11344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658437.318923:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 242 00000100:00080000:2.0:1788658437.319113:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658437.319118:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658437.319122:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658437.320431:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000983552:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 12298us (13254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658437.320445:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 370 00000100:00100000:3.0:1788658437.327074:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000984064:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 18840us (19588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658437.327106:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 240 00000100:00100000:0.0:1788658437.327902:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000983680:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 17716us (20380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658437.327913:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 241 00010000:00010000:2.0:1788658437.569269:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658437.823530:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788658437.887560:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788658438.593079:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658438.593400:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658438.593421:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025190528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658438.593484:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658438.594416:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025190528 00000100:00100000:2.0:1788658438.594425:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025190528 00000100:00100000:2.0:1788658438.594477:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788658438.594486:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025190528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658438.594516:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788658438.594570:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025190528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658438.595070:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025190528:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658438.598006:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00010000:00010000:3.0:1788658439.614841:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658440.127177:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658440.127200:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025190784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658440.127271:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.127331:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658440.127340:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025190656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658440.127364:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.127390:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025190784 00000100:00100000:1.0:1788658440.127397:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025190784 00000100:00100000:1.0:1788658440.127439:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025190656 00000100:00100000:1.0:1788658440.127441:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025190656 00000100:00100000:1.0:1788658440.127473:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788658440.127482:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025190784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658440.127511:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658440.127558:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025190784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658440.127566:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788658440.127586:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788658440.127592:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025190656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658440.127601:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658440.127629:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025190656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658440.127636:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788658440.127658:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025191040:0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.127699:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.127767:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025190656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658440.127789:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025191552:0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.127820:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.127846:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025192064:0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.127861:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025190912:0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.127869:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.127895:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788658440.127905:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025191168:0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.127909:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658440.127939:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025191424:0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.127943:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.127966:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025191680:0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.127974:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658440.127998:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025191936:0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.127999:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.128030:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025192192:0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.128031:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.128063:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658440.128070:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025190784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658440.128094:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788658440.128103:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025191296:0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.128104:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025191168 00000100:00100000:1.0:1788658440.128109:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025191168 00000100:00100000:1.0:1788658440.128137:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025191424 00000100:00100000:1.0:1788658440.128141:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025191424 00000100:00100000:0.0:1788658440.128151:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.128161:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788658440.128179:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025191808:0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.128181:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025191168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.128211:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.128237:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025191168:12345-0@lo:400:kworker.0 Request processed in 59us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658440.128241:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025191040 00000100:00100000:1.0:1788658440.128246:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788658440.128247:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025191040 00000100:00100000:1.0:1788658440.128264:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788658440.128274:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025191424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.128275:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025191552 00000100:00100000:0.0:1788658440.128281:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025191552 00000100:00100000:0.0:1788658440.128301:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025192064 00000100:00100000:0.0:1788658440.128305:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025192064 00000100:00100000:1.0:1788658440.128320:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025191424:12345-0@lo:400:kworker.0 Request processed in 47us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658440.128322:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025191680 00000100:00100000:0.0:1788658440.128326:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025191680 00000100:00100000:1.0:1788658440.128330:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788658440.128345:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025192192 00000100:00100000:0.0:1788658440.128349:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025192192 00000100:00100000:1.0:1788658440.128364:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025191168:0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.128367:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025191296 00000100:00100000:0.0:1788658440.128370:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025191296 00000100:00100000:0.0:1788658440.128389:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788658440.128398:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025191040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.128399:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025191424:0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.128463:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025191040:0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.128551:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025191040:12345-0@lo:400:kworker.0 Request processed in 155us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658440.128558:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788658440.128573:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788658440.128579:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025191552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658440.128611:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025190912 00000100:00100000:0.0:1788658440.128613:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025191552:12345-0@lo:400:kworker.0 Request processed in 35us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658440.128617:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025190912 00000100:00100000:0.0:1788658440.128623:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788658440.128640:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788658440.128653:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788658440.128657:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025192064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658440.128677:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025190912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.128694:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025192064:12345-0@lo:400:kworker.0 Request processed in 41us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658440.128730:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788658440.128749:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025190912:12345-0@lo:400:kworker.0 Request processed in 85us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658440.128749:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788658440.128762:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788658440.128764:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025191680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.128801:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025191680:12345-0@lo:400:kworker.0 Request processed in 42us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658440.128804:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788658440.128814:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788658440.128817:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025192192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.128833:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788658440.128843:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025191296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658440.128855:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025192192:12345-0@lo:400:kworker.0 Request processed in 41us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658440.128863:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788658440.128881:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025191296:12345-0@lo:400:kworker.0 Request processed in 40us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658440.128886:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025191936 00000100:00100000:0.0:1788658440.128890:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788658440.128892:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025191936 00000100:00100000:3.0:1788658440.128925:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025191808 00000100:00100000:3.0:1788658440.128928:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025191808 00000100:00100000:0.0:1788658440.128949:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025191296:0@lo:400:kworker.0 00000100:00100000:3.0:1788658440.128953:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788658440.128963:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025191936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.128964:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025190912:0@lo:400:kworker.0 00000100:00100000:0.0:1788658440.129002:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788658440.129010:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025191936:12345-0@lo:400:kworker.0 Request processed in 48us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658440.129013:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdc26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025191808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658440.129023:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788658440.129053:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdc26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025191808:12345-0@lo:400:kworker.0 Request processed in 44us (842us total) trans 0 rc 0/0 00010000:00080000:3.0:1788658440.129058:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c20380 x1875544025191808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658440.129062:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788658440.129075:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025191808:0@lo:400:kworker.0 00010000:00080000:3.0:1788658440.129101:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c20e00 x1875544025191936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658440.129111:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025191936:0@lo:400:kworker.0 00010000:00080000:1.0:1788658440.129350:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef4700 x1875544025191680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658440.129360:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025191680:0@lo:400:kworker.0 00010000:00080000:1.0:1788658440.129369:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c20700 x1875544025192192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658440.129387:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025192192:0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.129397:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025191552:0@lo:400:kworker.0 00000100:00100000:1.0:1788658440.129406:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025192064:0@lo:400:kworker.0 00000100:00080000:2.0:1788658440.129489:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658440.129494:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658440.129497:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658440.129499:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658440.639413:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025192320:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658440.639496:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658440.639755:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025192320 00000100:00100000:3.0:1788658440.639763:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025192320 00000100:00100000:3.0:1788658440.639805:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788658440.639815:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025192320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658440.639842:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658440.639888:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025192320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658440.639895:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00010000:2.0:1788658440.640194:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788658440.640227:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834e6680 x1875544025192320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658440.640256:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025192320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658440.646024:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658440.646048:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025192448:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788658440.646080:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1788658440.646129:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658440.646314:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025192448 00000100:00100000:1.0:1788658440.646323:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025192448 00000100:00100000:1.0:1788658440.646380:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788658440.646398:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025192448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658440.646422:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658440.646477:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025192448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658440.646484:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:0.0:1788658440.646594:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c7ad80 x1875544025192448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658440.646613:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025192448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658441.150949:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025192576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658441.151020:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658441.151157:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025192576 00000100:00100000:3.0:1788658441.151165:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025192576 00000100:00100000:3.0:1788658441.151217:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788658441.151226:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025192576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658441.151260:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788658441.153146:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025192576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1912us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658441.153159:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788658441.158497:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025192576:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788658441.663111:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658442.430138:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658442.430185:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658442.430216:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658442.430265:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658442.430294:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658442.430319:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658442.430345:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000984576 00000100:00100000:2.0:1788658442.430354:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000984576 00000100:00100000:2.0:1788658442.430406:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000984832 00000100:00100000:2.0:1788658442.430409:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000984832 00000100:00100000:2.0:1788658442.430421:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000984448 00000100:00100000:2.0:1788658442.430423:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000984448 00000100:00100000:2.0:1788658442.430434:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000984960 00000100:00100000:2.0:1788658442.430436:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000984960 00000100:00100000:2.0:1788658442.430452:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 249 00000100:00100000:2.0:1788658442.430461:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000984576:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658442.430532:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000984576:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 71us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658442.430540:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 249 00000100:00100000:2.0:1788658442.430558:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 250 00000100:00100000:2.0:1788658442.430565:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000984832:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658442.430589:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000984832:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658442.430596:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 250 00000100:00100000:2.0:1788658442.430606:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 251 00000100:00100000:2.0:1788658442.430611:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000984448:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658442.430634:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000984448:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658442.430640:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 251 00000100:00100000:2.0:1788658442.430660:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 252 00000100:00100000:2.0:1788658442.430666:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000984960:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658442.430688:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544000984960:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658442.430694:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 252 00000100:00080000:2.0:1788658442.430760:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658442.430765:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658442.431152:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000984704 00000100:00100000:3.0:1788658442.431158:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000984704 00000100:00100000:3.0:1788658442.431209:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:3.0:1788658442.431217:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000984704:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658442.431247:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83468e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544000984704:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 32us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658442.431264:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:1.0:1788658442.431342:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000984320 00000100:00100000:1.0:1788658442.431347:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000984320 00000100:00100000:1.0:1788658442.431385:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 372 00000100:00100000:1.0:1788658442.431392:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000984320:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658442.431419:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544000984320:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658442.431426:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 372 00000100:00080000:0.0:1788658442.431503:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788658442.687076:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658443.711018:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025192704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658443.711197:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658443.711219:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658443.714999:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025192704 00000100:00100000:3.0:1788658443.715023:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025192704 00000100:00100000:3.0:1788658443.715130:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788658443.715145:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025192704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658443.715200:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658443.715332:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025192704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 191us (4135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658443.715340:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788658443.715585:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025192704:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788658444.735979:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658445.248041:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658445.248073:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025192832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658445.248184:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658445.248283:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025192832 00000100:00100000:1.0:1788658445.248293:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025192832 00000100:00100000:1.0:1788658445.248359:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788658445.248372:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025192832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658445.248410:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658445.248463:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025192832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658445.248471:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788658445.248520:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788658445.248527:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1eb377fb80, transno 4294967301 00000100:00100000:1.0:1788658445.248546:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025192832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658445.248848:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025193088:0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.248894:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658445.248924:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025193600:0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.248945:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658445.248970:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025194112:0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.248990:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658445.249018:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788658445.249026:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025193216:0@lo:400:kworker.0 00000100:00100000:2.0:1788658445.249032:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025193088 00000100:00100000:2.0:1788658445.249039:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025193088 00000100:00100000:3.0:1788658445.249055:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658445.249076:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025193728:0@lo:400:kworker.0 00000100:00100000:2.0:1788658445.249077:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025193600 00000100:00100000:2.0:1788658445.249081:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025193600 00000100:00100000:3.0:1788658445.249106:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658445.249121:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025194112 00000100:00100000:2.0:1788658445.249126:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025194112 00000100:00100000:3.0:1788658445.249129:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025194240:0@lo:400:kworker.0 00000100:00100000:2.0:1788658445.249147:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025193728 00000100:00100000:2.0:1788658445.249151:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025193728 00000100:00100000:3.0:1788658445.249158:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658445.249170:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025194240 00000100:00100000:2.0:1788658445.249173:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025194240 00000100:00100000:3.0:1788658445.249190:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788658445.249217:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025193088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.249262:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025193088:12345-0@lo:400:kworker.0 Request processed in 48us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658445.249317:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025192960:0@lo:400:kworker.0 00000100:00100000:1.0:1788658445.249353:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658445.249383:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025193344:0@lo:400:kworker.0 00000100:00100000:0.0:1788658445.249416:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658445.249430:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025193856:0@lo:400:kworker.0 00000100:00100000:0.0:1788658445.249455:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658445.256319:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788658445.256336:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788658445.256418:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025193344 00000100:00100000:3.0:1788658445.256429:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025193344 00000100:00100000:3.0:1788658445.256468:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788658445.256478:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025194112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.256755:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025194112:12345-0@lo:400:kworker.0 Request processed in 278us (7762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658445.256764:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788658445.256778:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788658445.256786:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025193728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.256817:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025193728:12345-0@lo:400:kworker.0 Request processed in 33us (7711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658445.256934:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788658445.256951:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788658445.256958:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025194240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.256994:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025194240:12345-0@lo:400:kworker.0 Request processed in 37us (7837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658445.257000:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788658445.257011:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788658445.257017:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025193344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.257050:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025193344:12345-0@lo:400:kworker.0 Request processed in 34us (7634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658445.257076:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788658445.257112:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025193216 00000100:00100000:3.0:1788658445.257117:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025193216 00000100:00100000:3.0:1788658445.257155:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788658445.257160:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025193216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.257194:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025193216:12345-0@lo:400:kworker.0 Request processed in 34us (8141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658445.257200:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788658445.257252:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025193216:0@lo:400:kworker.0 00010000:00080000:3.0:1788658445.257269:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834e5180 x1875544025193728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658445.257281:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025193728:0@lo:400:kworker.0 00010000:00080000:3.0:1788658445.257293:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834e5f80 x1875544025194240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658445.257301:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025194240:0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.257313:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025193088:0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.257324:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025194112:0@lo:400:kworker.0 00000100:00100000:2.0:1788658445.259490:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025193600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658445.259639:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025193600:12345-0@lo:400:kworker.0 Request processed in 3301us (10689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658445.259651:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788658445.262145:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025193600:0@lo:400:kworker.0 00000100:00100000:1.0:1788658445.263166:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025193472:0@lo:400:kworker.0 00000100:00100000:1.0:1788658445.263255:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658445.263289:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025193984:0@lo:400:kworker.0 00000100:00100000:1.0:1788658445.263335:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025193472 00000100:00100000:1.0:1788658445.263344:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025193472 00000100:00100000:1.0:1788658445.263418:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788658445.263429:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025193472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658445.263504:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025193472:12345-0@lo:400:kworker.0 Request processed in 77us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658445.263533:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1788658445.263590:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658445.263598:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658445.263602:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658445.263643:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025192960 00000100:00100000:1.0:1788658445.263648:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025192960 00000100:00100000:1.0:1788658445.263676:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788658445.263683:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025192960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658445.263761:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025192960:12345-0@lo:400:kworker.0 Request processed in 78us (14406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658445.265480:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788658445.278374:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025193856 00000100:00100000:3.0:1788658445.278392:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025193856 00000100:00100000:3.0:1788658445.278491:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788658445.278504:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025193856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658445.278582:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025194368:0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.278626:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025193856:12345-0@lo:400:kworker.0 Request processed in 124us (29166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658445.278650:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658445.278663:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788658445.278683:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658445.278693:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025194496:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788658445.278756:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658445.278773:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025193984 00000100:00100000:3.0:1788658445.278777:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025193984 00000100:00100000:2.0:1788658445.278787:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025194368 00000100:00100000:2.0:1788658445.278790:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025194368 00000100:00100000:3.0:1788658445.278804:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788658445.278809:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025193984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658445.278821:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788658445.278828:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025194368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658445.278868:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025194368:12345-0@lo:400:kworker.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658445.278875:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1788658445.278891:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658445.278893:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658445.278901:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025193984:12345-0@lo:400:kworker.0 Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658445.278910:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025193344:0@lo:400:kworker.0 00000100:00100000:3.0:1788658445.278911:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1788658445.279020:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834e4000 x1875544025193856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658445.279033:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025193856:0@lo:400:kworker.0 00000100:00100000:1.0:1788658445.279196:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658445.279253:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025192960:0@lo:400:kworker.0 00000100:00100000:1.0:1788658445.279276:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025193472:0@lo:400:kworker.0 00010000:00080000:1.0:1788658445.279289:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834e6300 x1875544025193984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658445.279305:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025193984:0@lo:400:kworker.0 00000100:00100000:2.0:1788658445.279391:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025194496 00000100:00100000:2.0:1788658445.279395:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025194496 00000100:00100000:2.0:1788658445.279449:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788658445.279455:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025194496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658445.279472:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658445.279512:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025194496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658445.279519:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788658445.279558:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025194496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658445.287886:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025194368:0@lo:400:kworker.0 00000100:00100000:1.0:1788658445.759359:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658445.759397:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025194624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658445.759494:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658445.761859:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658445.761890:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025194752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658445.761974:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658445.762060:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025194624 00000100:00100000:0.0:1788658445.762071:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025194624 00000100:00100000:0.0:1788658445.762119:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025194752 00000100:00100000:0.0:1788658445.762123:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025194752 00000100:00100000:0.0:1788658445.762160:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788658445.762169:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025194624:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788658445.765252:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:0.0:1788658445.766282:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658445.766447:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025194624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4271us (6945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658445.766460:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788658445.766503:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788658445.766516:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025194752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658445.766557:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658445.766609:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025194752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (4636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658445.766616:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:0.0:1788658445.766692:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c21180 x1875544025194752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658445.766750:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025194752:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788658445.769355:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d836cc700 x1875544025194624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658445.769429:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025194624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658446.271052:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025194880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658446.271155:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658446.271794:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025194880 00000100:00100000:2.0:1788658446.271808:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025194880 00000100:00100000:2.0:1788658446.271881:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788658446.271903:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025194880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658446.272106:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788658446.272197:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025194880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 305us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658446.272206:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788658446.272326:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025194880:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788658446.784422:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658447.060968:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788658447.104810:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788658447.549678:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658447.549770:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658447.549797:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658447.549843:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658447.549881:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658447.549907:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658447.549939:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000985216 00000100:00100000:2.0:1788658447.549950:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000985216 00000100:00100000:2.0:1788658447.550008:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000985728 00000100:00100000:2.0:1788658447.550011:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000985728 00000100:00100000:2.0:1788658447.550025:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000985344 00000100:00100000:2.0:1788658447.550028:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000985344 00000100:00100000:2.0:1788658447.550040:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000985600 00000100:00100000:2.0:1788658447.550042:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000985600 00000100:00100000:2.0:1788658447.550059:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 259 00000100:00100000:2.0:1788658447.550069:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000985216:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658447.550139:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83468700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000985216:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 71us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658447.550147:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 259 00000100:00100000:2.0:1788658447.550165:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 260 00000100:00100000:2.0:1788658447.550171:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544000985728:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658447.550197:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83469180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544000985728:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658447.550203:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 260 00000100:00100000:2.0:1788658447.550215:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 261 00000100:00100000:2.0:1788658447.550221:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000985344:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658447.550243:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000985344:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658447.550250:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 261 00000100:00100000:2.0:1788658447.550260:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 262 00000100:00100000:2.0:1788658447.550273:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544000985600:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658447.550297:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544000985600:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658447.550304:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 262 00000100:00080000:2.0:1788658447.550320:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658447.550325:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658447.550504:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000985472 00000100:00100000:0.0:1788658447.550509:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000985472 00000100:00100000:0.0:1788658447.550565:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 93 00000100:00100000:0.0:1788658447.550574:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000985472:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658447.550602:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000985472:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 31us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658447.550608:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 93 00000100:00080000:2.0:1788658447.551050:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658447.551687:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000985088 00000100:00100000:3.0:1788658447.551694:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000985088 00000100:00100000:3.0:1788658447.551768:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 374 00000100:00100000:3.0:1788658447.551777:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2396:x1875544000985088:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658447.551824:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2396:x1875544000985088:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 48us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658447.551833:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 374 00010000:00010000:1.0:1788658447.807583:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658448.830993:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025195008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658448.831069:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658448.831290:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658448.831352:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025195008 00000100:00100000:2.0:1788658448.831360:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025195008 00000100:00100000:2.0:1788658448.831424:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788658448.831434:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025195008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658448.831472:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788658448.831538:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025195008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658448.831545:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788658448.832136:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025195008:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788658449.855036:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658450.366886:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658450.366908:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025195136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658450.366972:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658450.367298:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025195392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658450.367340:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658450.367369:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025195648:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.367384:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025195264:0@lo:400:kworker.0 00000100:00100000:3.0:1788658450.367410:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658450.367426:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658450.367437:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025196160:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.367459:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025195776:0@lo:400:kworker.0 00000100:00100000:3.0:1788658450.367467:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658450.367488:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025196672:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.367505:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658450.367531:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025196288:0@lo:400:kworker.0 00000100:00100000:3.0:1788658450.367538:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658450.367570:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658450.367582:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025195648 00000100:00100000:3.0:1788658450.367590:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025195648 00000100:00100000:1.0:1788658450.367608:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e840c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025196800:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.367634:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658450.367640:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788658450.367652:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025195648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.367671:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025195264 00000100:00100000:1.0:1788658450.367676:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025195264 00000100:00100000:1.0:1788658450.367739:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788658450.367741:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025195648:12345-0@lo:400:kworker.0 Request processed in 91us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658450.367751:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025195264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658450.367752:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788658450.367780:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025196288 00000100:00100000:3.0:1788658450.367785:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025196288 00000100:00100000:1.0:1788658450.367797:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025195264:12345-0@lo:400:kworker.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658450.367812:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788658450.367839:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025196800 00000100:00100000:3.0:1788658450.367844:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025196800 00000100:00100000:1.0:1788658450.367852:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788658450.367862:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025196288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658450.367871:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788658450.367882:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025196800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.367897:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025196288:12345-0@lo:400:kworker.0 Request processed in 36us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658450.367904:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788658450.367924:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025196800:12345-0@lo:400:kworker.0 Request processed in 44us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658450.367930:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025196160 00000100:00100000:3.0:1788658450.367933:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788658450.367936:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025196160 00000100:00100000:3.0:1788658450.367961:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025195776 00000100:00100000:3.0:1788658450.367966:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025195776 00000100:00100000:1.0:1788658450.367973:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025196672 00000100:00100000:1.0:1788658450.367979:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025196672 00000100:00100000:3.0:1788658450.367996:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788658450.368004:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025196160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658450.368040:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025196160:12345-0@lo:400:kworker.0 Request processed in 38us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658450.371133:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788658450.371167:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025195776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.371251:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025195776:12345-0@lo:400:kworker.0 Request processed in 107us (3749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658450.371258:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788658450.371281:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788658450.371288:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025196672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.371319:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025196672:12345-0@lo:400:kworker.0 Request processed in 32us (3786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658450.371325:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788658450.371386:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025195264:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.371401:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025195776:0@lo:400:kworker.0 00010000:00080000:1.0:1788658450.371417:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834e6300 x1875544025196288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658450.371449:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025196288:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.371477:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e840c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025196800:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.371555:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025195520:0@lo:400:kworker.0 00000100:00100000:2.0:1788658450.371931:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025195904:0@lo:400:kworker.0 00000100:00100000:2.0:1788658450.371964:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658450.371985:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025196416:0@lo:400:kworker.0 00000100:00100000:2.0:1788658450.372010:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658450.372041:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025195904 00000100:00100000:2.0:1788658450.372047:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025195904 00000100:00100000:2.0:1788658450.372081:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788658450.372088:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025195904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658450.372126:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025195904:12345-0@lo:400:kworker.0 Request processed in 38us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658450.372154:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1788658450.372175:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658450.372181:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658450.372185:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658450.372196:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025196416 00000100:00100000:2.0:1788658450.372200:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025196416 00000100:00100000:2.0:1788658450.372231:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788658450.372237:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025196416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658450.372270:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025196416:12345-0@lo:400:kworker.0 Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658450.372275:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:2.0:1788658450.372290:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658450.372310:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025195904:0@lo:400:kworker.0 00010000:00080000:2.0:1788658450.372320:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834e5880 x1875544025196416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658450.372328:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025196416:0@lo:400:kworker.0 00000100:00100000:2.0:1788658450.372365:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025195648:0@lo:400:kworker.0 00010000:00080000:2.0:1788658450.372379:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834e7480 x1875544025196160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658450.372389:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025196160:0@lo:400:kworker.0 00010000:00080000:2.0:1788658450.372400:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d834e6a00 x1875544025196672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658450.372408:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025196672:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.372573:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658450.372608:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025196032:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.372629:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658450.372646:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025196544:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.372666:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658450.372700:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025195520 00000100:00100000:1.0:1788658450.372717:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025195520 00000100:00100000:3.0:1788658450.372895:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788658450.372916:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025196032 00000100:00100000:3.0:1788658450.372919:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025196032 00000100:00080000:3.0:1788658450.372937:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658450.372955:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025196544 00000100:00100000:3.0:1788658450.372966:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025196544 00000100:00080000:3.0:1788658450.372983:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658450.372984:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788658450.372995:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025196032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658450.373001:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788658450.373012:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025195520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.373044:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025196032:12345-0@lo:400:kworker.0 Request processed in 51us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658450.373051:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788658450.373063:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025195520:12345-0@lo:400:kworker.0 Request processed in 51us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658450.373071:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788658450.373091:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025195520:0@lo:400:kworker.0 00000100:00100000:1.0:1788658450.373104:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025196032:0@lo:400:kworker.0 00000100:00100000:3.0:1788658450.373123:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788658450.373132:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e840c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025196544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658450.373324:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e840c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025196544:12345-0@lo:400:kworker.0 Request processed in 192us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658450.373331:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788658450.374320:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025196544:0@lo:400:kworker.0 00000100:00100000:0.0:1788658450.376524:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025195136 00000100:00100000:0.0:1788658450.376556:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025195136 00000100:00100000:0.0:1788658450.376850:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025195392 00000100:00100000:0.0:1788658450.376855:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025195392 00000100:00100000:0.0:1788658450.376874:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788658450.376883:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025195136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658450.376916:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658450.376992:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025195136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (10019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658450.376998:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788658450.377015:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788658450.377020:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025195392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658450.377029:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658450.377058:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83469c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025195392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (9720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658450.377064:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788658450.377106:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025195392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658450.377301:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025195136:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788658450.379181:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658450.879148:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025196928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658450.879233:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658450.879357:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025196928 00000100:00100000:0.0:1788658450.879366:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025196928 00000100:00100000:0.0:1788658450.879422:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788658450.879432:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025196928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658450.879461:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658450.879505:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025196928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658450.879512:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1788658450.879688:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c22300 x1875544025196928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658450.879727:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025196928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658450.879999:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658450.880007:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025197056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658450.880032:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658450.880106:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025197056 00000100:00100000:0.0:1788658450.880110:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025197056 00000100:00100000:0.0:1788658450.880137:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788658450.880150:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025197056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658450.880160:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658450.880186:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025197056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658450.880192:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1788658450.880248:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c23100 x1875544025197056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658450.880260:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025197056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788658450.880653:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658451.391005:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025197184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658451.391096:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658451.391331:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025197184 00000100:00100000:2.0:1788658451.391339:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025197184 00000100:00100000:2.0:1788658451.391398:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788658451.391408:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025197184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658451.391442:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788658451.391492:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025197184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658451.391498:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788658451.391519:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025197184:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788658451.902984:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658452.667337:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658452.667386:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658452.667424:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658452.667511:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000986112 00000100:00100000:0.0:1788658452.667522:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000986112 00000100:00100000:3.0:1788658452.667547:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000985856 00000100:00100000:3.0:1788658452.667552:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000985856 00000100:00100000:0.0:1788658452.667595:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000985984 00000100:00100000:3.0:1788658452.667597:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 376 00000100:00100000:0.0:1788658452.667598:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000985984 00000100:00100000:3.0:1788658452.667607:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544000985856:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658452.667619:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 269 00000100:00100000:0.0:1788658452.667625:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000986112:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658452.667676:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000986112:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 51us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658452.667684:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 269 00000100:00100000:1.0:1788658452.667690:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 270 00000100:00100000:1.0:1788658452.667699:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000985984:12345-192.168.202.53@tcp:400:kworker.0 00000100:00080000:2.0:1788658452.667788:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658452.667792:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658452.671311:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544000985856:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 3692us (3973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658452.671327:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 376 00000100:00100000:1.0:1788658452.672164:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000985984:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 4461us (4733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658452.672176:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 270 00000100:00100000:1.0:1788658452.687924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658452.687967:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658452.688004:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658452.688200:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000986240 00000100:00100000:2.0:1788658452.688209:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000986240 00000100:00100000:2.0:1788658452.688275:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:2.0:1788658452.688299:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2395:x1875544000986240:12345-192.168.202.53@tcp:9:kworker.0 00000020:00000080:2.0:1788658452.688326:0:8454:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6eac9 00000100:00080000:2.0:1788658452.688335:0:8454:0:(import.c:65:import_set_state_nolock()) ffff8a1d835f3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658452.688376:0:8454:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:2.0:1788658452.688541:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+2:2395:x1875544000986240:12345-192.168.202.53@tcp:9:kworker.0 Request processed in 243us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658452.688549:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:3.0:1788658452.688787:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000986368 00000100:00100000:3.0:1788658452.688791:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000986368 00000100:00100000:3.0:1788658452.688831:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000986496 00000100:00100000:3.0:1788658452.688834:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000986496 00000100:00100000:3.0:1788658452.688874:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 271 00000100:00100000:3.0:1788658452.688899:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544000986368:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658452.688939:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544000986368:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 42us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658452.688947:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 271 00000100:00100000:3.0:1788658452.688961:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 272 00000100:00100000:3.0:1788658452.688968:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000986496:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658452.688992:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000986496:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658452.688999:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 272 00010000:00010000:1.0:1788658452.689337:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658452.689346:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658452.689351:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658452.689353:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788658452.927072:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658453.950993:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658453.951108:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025197312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658453.951181:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658453.951349:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025197312 00000100:00100000:2.0:1788658453.951357:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025197312 00000100:00100000:2.0:1788658453.951413:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788658453.951422:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025197312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658453.951456:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788658453.951510:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025197312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658453.951516:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788658453.951601:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025197312:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788658454.975008:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658455.487180:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658455.487205:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025197440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658455.487279:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658455.487450:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025197440 00000100:00100000:1.0:1788658455.487458:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025197440 00000100:00100000:1.0:1788658455.487517:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788658455.487526:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025197440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658455.487556:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658455.487615:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025197440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.487622:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788658455.487669:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025197440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658455.487881:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025197696:0@lo:400:kworker.0 00000100:00100000:2.0:1788658455.487924:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.487943:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025198208:0@lo:400:kworker.0 00000100:00100000:2.0:1788658455.487965:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.487986:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025198720:0@lo:400:kworker.0 00000100:00100000:0.0:1788658455.487998:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025197952:0@lo:400:kworker.0 00000100:00100000:2.0:1788658455.488008:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.488024:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788658455.488026:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.488029:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025197824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658455.488042:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025198464:0@lo:400:kworker.0 00000100:00100000:2.0:1788658455.488048:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658455.488061:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.488066:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025198336:0@lo:400:kworker.0 00000100:00100000:0.0:1788658455.488074:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025198976:0@lo:400:kworker.0 00000100:00100000:0.0:1788658455.488093:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.488106:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025198208 00000100:00100000:2.0:1788658455.488110:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025198208 00000100:00100000:0.0:1788658455.488113:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788658455.488117:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025197568:0@lo:400:kworker.0 00000100:00100000:2.0:1788658455.488133:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025197952 00000100:00100000:2.0:1788658455.488135:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025197952 00000100:00100000:2.0:1788658455.488147:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788658455.488153:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025198208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658455.488154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658455.488181:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025198080:0@lo:400:kworker.0 00000100:00100000:2.0:1788658455.488184:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025198208:12345-0@lo:400:kworker.0 Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.488190:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788658455.488200:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.488203:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788658455.488208:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025197952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658455.488217:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025198592:0@lo:400:kworker.0 00000100:00100000:2.0:1788658455.488233:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025197952:12345-0@lo:400:kworker.0 Request processed in 25us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658455.488235:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.488238:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788658455.488249:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025199104:0@lo:400:kworker.0 00000100:00100000:2.0:1788658455.488254:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025198720 00000100:00100000:2.0:1788658455.488257:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025198720 00000100:00100000:0.0:1788658455.488270:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658455.488337:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025197696 00000100:00100000:1.0:1788658455.488347:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025197696 00000100:00100000:1.0:1788658455.488374:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025198464 00000100:00100000:1.0:1788658455.488376:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025198464 00000100:00100000:1.0:1788658455.488388:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025198976 00000100:00100000:1.0:1788658455.488390:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025198976 00000100:00100000:1.0:1788658455.488399:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025198080 00000100:00100000:1.0:1788658455.488401:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025198080 00000100:00100000:1.0:1788658455.488412:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788658455.488418:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025197696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658455.488466:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025197952:0@lo:400:kworker.0 00000100:00100000:0.0:1788658455.488493:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788658455.488500:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025198464:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788658455.488568:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658455.488573:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658455.488575:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658455.500222:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025198592 00000100:00100000:2.0:1788658455.500235:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025199104 00000100:00100000:3.0:1788658455.500237:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025198592 00000100:00100000:2.0:1788658455.500239:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025199104 00000100:00100000:2.0:1788658455.500291:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788658455.500301:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025198720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658455.505265:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788658455.505296:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025198592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.505613:0:10365:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788658455.505625:0:10365:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788658455.505655:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025197568 00000100:00100000:1.0:1788658455.505663:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025197568 00000100:00100000:1.0:1788658455.505736:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788658455.505745:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025197568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.505809:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae32f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025197568:12345-0@lo:400:kworker.0 Request processed in 66us (17665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.505817:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788658455.505874:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025197824 00000100:00100000:1.0:1788658455.505887:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025197824 00000100:00100000:1.0:1788658455.505921:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788658455.505928:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875544025197824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658455.505943:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658455.505977:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875544025197824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (17927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.505983:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788658455.506011:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025197696:12345-0@lo:400:kworker.0 Request processed in 17594us (18087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.506019:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788658455.506053:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788658455.506060:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025198976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506092:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025198976:12345-0@lo:400:kworker.0 Request processed in 33us (17998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.506098:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788658455.506110:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788658455.506116:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025198080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506155:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025198080:12345-0@lo:400:kworker.0 Request processed in 28us (17941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.506162:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788658455.506293:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025197568:0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506307:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025198080:0@lo:400:kworker.0 00010000:00080000:1.0:1788658455.506333:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c20380 x1875544025198976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658455.506344:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025198976:0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506391:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788658455.506398:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025199104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506437:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025199104:12345-0@lo:400:kworker.0 Request processed in 39us (18166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.506443:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788658455.506470:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025199104:0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506578:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658455.506620:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025198848:0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506658:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658455.506686:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025197696:0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506697:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025198208:0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506750:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025197824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658455.506769:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025198336 00000100:00100000:1.0:1788658455.506773:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025198336 00000100:00100000:1.0:1788658455.506795:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025198848 00000100:00100000:1.0:1788658455.506797:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025198848 00000100:00100000:1.0:1788658455.506810:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788658455.506816:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025198336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506849:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025198336:12345-0@lo:400:kworker.0 Request processed in 32us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.506855:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788658455.506866:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788658455.506872:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025198848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506896:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025198848:12345-0@lo:400:kworker.0 Request processed in 24us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658455.506902:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788658455.506931:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025198336:0@lo:400:kworker.0 00000100:00100000:1.0:1788658455.506940:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025198848:0@lo:400:kworker.0 00000100:00080000:1.0:1788658455.506989:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658455.506993:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658455.506996:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658455.516379:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025198464:12345-0@lo:400:kworker.0 Request processed in 27867us (28305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658455.516394:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788658455.522001:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025198720:12345-0@lo:400:kworker.0 Request processed in 21691us (33980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.522016:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:2.0:1788658455.522076:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c20700 x1875544025198720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658455.522092:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025198720:0@lo:400:kworker.0 00010000:00080000:1.0:1788658455.524727:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c21c00 x1875544025198464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658455.524767:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025198464:0@lo:400:kworker.0 00000100:00100000:3.0:1788658455.526283:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025198592:12345-0@lo:400:kworker.0 Request processed in 20995us (38037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658455.526297:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1788658455.526311:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c23800 x1875544025198592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658455.526322:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025198592:0@lo:400:kworker.0 00010000:00010000:0.0:1788658455.998984:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658455.999213:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025199232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658455.999295:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658455.999467:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025199232 00000100:00100000:2.0:1788658455.999475:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025199232 00000100:00100000:2.0:1788658455.999554:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788658455.999563:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025199232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788658455.999603:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658455.999646:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025199232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658455.999653:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788658455.999970:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025199360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658456.000005:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658456.000209:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025199360 00000100:00100000:2.0:1788658456.000214:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025199360 00000100:00100000:2.0:1788658456.000236:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788658456.000243:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025199360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658456.000256:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658456.000370:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025199360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658456.000377:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:1.0:1788658456.000456:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3a300 x1875544025199360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658456.000473:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025199360:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788658456.000560:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e84432300 x1875544025199232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658456.000952:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025199232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658456.525687:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658456.525739:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025199488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658456.525821:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658456.525953:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025199488 00000100:00100000:2.0:1788658456.525962:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025199488 00000100:00100000:2.0:1788658456.526005:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788658456.526014:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025199488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658456.526049:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788658456.526096:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025199488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658456.526102:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788658456.526242:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025199488:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658457.027737:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658457.282759:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788658457.356627:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788658457.790848:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658457.790895:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658457.790924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658457.790943:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658457.790966:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658457.790993:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000986752 00000100:00100000:3.0:1788658457.791002:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000986752 00000100:00100000:3.0:1788658457.791064:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000987008 00000100:00100000:3.0:1788658457.791068:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000987008 00000100:00100000:3.0:1788658457.791083:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000986880 00000100:00100000:3.0:1788658457.791085:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000986880 00000100:00100000:3.0:1788658457.791097:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000987136 00000100:00100000:3.0:1788658457.791099:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000987136 00000100:00100000:3.0:1788658457.791116:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 279 00000100:00100000:3.0:1788658457.791127:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000986752:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658457.791217:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000986752:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 91us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658457.791225:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 279 00000100:00100000:3.0:1788658457.791244:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 280 00000100:00100000:3.0:1788658457.791251:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544000987008:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658457.791287:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544000987008:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 36us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658457.791305:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 280 00000100:00100000:3.0:1788658457.791319:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 281 00000100:00100000:3.0:1788658457.791326:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000986880:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658457.791350:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544000986880:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658457.791357:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 281 00000100:00100000:3.0:1788658457.791369:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 282 00000100:00100000:3.0:1788658457.791375:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544000987136:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658457.791396:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544000987136:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 21us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658457.791401:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 282 00000100:00100000:3.0:1788658457.791420:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000986624 00000100:00100000:3.0:1788658457.791423:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000986624 00000100:00100000:3.0:1788658457.791449:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 378 00000100:00100000:3.0:1788658457.791455:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e88550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2396:x1875544000986624:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658457.791479:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e88550c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2396:x1875544000986624:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658457.791485:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 378 00000100:00080000:3.0:1788658457.791515:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658457.791519:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788658458.062542:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788658458.567875:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:1.0:1788658458.567885:0:9530:0:(genops.c:885:class_export_put()) final put ffff8a1d835f1000/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:1.0:1788658458.567917:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d835f1000/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 for lustre-OST0001 00000020:00000080:1.0:1788658458.567965:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d835f3800 for lustre-OST0001 00010000:00010000:2.0:1788658459.071003:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658459.082626:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025199616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658459.082726:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658459.083187:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025199616 00000100:00100000:3.0:1788658459.083196:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025199616 00000100:00100000:3.0:1788658459.083270:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788658459.083279:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025199616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658459.083314:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658459.083365:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025199616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658459.083372:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788658459.083522:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025199616:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788658460.095048:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658460.610479:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658460.610511:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025199744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658460.610617:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658460.613660:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658460.613694:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025199872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658460.613865:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658460.614958:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025200000:0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.615028:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658460.615058:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025200512:0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.615085:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658460.615102:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025201024:0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.615123:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658460.615146:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788658460.615151:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025200128:0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.615189:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658460.615207:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025200640:0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.615225:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658460.615238:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025201152:0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.615256:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658460.615291:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025200000 00000100:00100000:0.0:1788658460.615299:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025200000 00000100:00100000:3.0:1788658460.615670:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025199744 00000100:00100000:3.0:1788658460.615676:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025199744 00000100:00100000:3.0:1788658460.615729:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025199872 00000100:00100000:3.0:1788658460.615732:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025199872 00000100:00100000:3.0:1788658460.615754:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788658460.615763:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025199744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658460.615877:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025200384:0@lo:400:kworker.0 00000100:00100000:1.0:1788658460.615918:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658460.615944:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025200896:0@lo:400:kworker.0 00000100:00100000:1.0:1788658460.615968:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658460.616046:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788658460.616055:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025200000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.616113:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025200000:12345-0@lo:400:kworker.0 Request processed in 59us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658460.616120:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788658460.616160:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025200512 00000100:00100000:0.0:1788658460.616164:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025200512 00000100:00100000:0.0:1788658460.616193:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788658460.616199:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025200512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.616237:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025200512:12345-0@lo:400:kworker.0 Request processed in 38us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658460.616243:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788658460.616300:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788658460.616319:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025200256:0@lo:400:kworker.0 00002000:00000024:3.0:1788658460.616432:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658460.618610:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025199744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2834us (7979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658460.618626:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788658460.618674:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788658460.618688:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025199872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788658460.618735:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658460.618799:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025199872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (4936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658460.618806:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788658460.618883:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025199872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658460.618949:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025200128 00000100:00100000:3.0:1788658460.618956:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025200128 00000100:00100000:3.0:1788658460.619018:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025200640 00000100:00100000:3.0:1788658460.619022:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025200640 00000100:00100000:3.0:1788658460.619039:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025201152 00000100:00100000:3.0:1788658460.619042:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025201152 00000100:00100000:3.0:1788658460.619056:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025200384 00000100:00100000:3.0:1788658460.619059:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025200384 00000100:00100000:3.0:1788658460.619071:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788658460.619077:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025200128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658460.619117:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025200128:12345-0@lo:400:kworker.0 Request processed in 40us (3927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658460.619123:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788658460.619135:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788658460.619141:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025200640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658460.619172:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025200640:12345-0@lo:400:kworker.0 Request processed in 31us (3946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658460.619178:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788658460.619190:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788658460.619195:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025201152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658460.619223:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025201152:12345-0@lo:400:kworker.0 Request processed in 29us (3966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658460.619229:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788658460.619241:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788658460.619247:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025200384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658460.619275:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025200384:12345-0@lo:400:kworker.0 Request processed in 30us (3357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658460.619288:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788658460.619912:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025201024 00000100:00100000:0.0:1788658460.619921:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025201024 00000100:00100000:0.0:1788658460.619969:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025200896 00000100:00100000:0.0:1788658460.619983:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025200896 00000100:00100000:0.0:1788658460.620014:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788658460.620022:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025201024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.620071:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025201024:12345-0@lo:400:kworker.0 Request processed in 52us (4947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658460.620087:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788658460.620102:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788658460.620108:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025200896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.620135:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025200896:12345-0@lo:400:kworker.0 Request processed in 27us (4167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658460.620141:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788658460.620293:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025200128:0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.620306:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025200640:0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.620317:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025201152:0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.620329:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025200000:0@lo:400:kworker.0 00000100:00100000:0.0:1788658460.620865:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025200512:0@lo:400:kworker.0 00010000:00080000:0.0:1788658460.620888:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c22300 x1875544025201024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658460.620898:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025201024:0@lo:400:kworker.0 00000100:00100000:1.0:1788658460.623552:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658460.623651:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025200768:0@lo:400:kworker.0 00000100:00100000:1.0:1788658460.623746:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658460.623795:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025200768 00000100:00100000:1.0:1788658460.623806:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025200768 00000100:00100000:1.0:1788658460.623876:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788658460.623887:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025200768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658460.623948:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025200768:12345-0@lo:400:kworker.0 Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658460.623955:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:1.0:1788658460.624018:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c20e00 x1875544025200768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658460.624035:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025200768:0@lo:400:kworker.0 00000100:00100000:1.0:1788658460.624044:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025201280:0@lo:400:kworker.0 00000100:00100000:1.0:1788658460.624069:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658460.624093:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025201280 00000100:00100000:1.0:1788658460.624097:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025201280 00000100:00100000:1.0:1788658460.624124:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788658460.624131:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025201280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658460.624162:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025201280:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658460.624168:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00010000:00080000:1.0:1788658460.624198:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c20380 x1875544025201280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658460.624208:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025201280:0@lo:400:kworker.0 00000100:00100000:1.0:1788658460.624236:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025200384:0@lo:400:kworker.0 00010000:00080000:1.0:1788658460.624251:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c21180 x1875544025200896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658460.624259:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025200896:0@lo:400:kworker.0 00000100:00100000:1.0:1788658460.624282:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025199744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658460.625987:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025200256 00000100:00100000:2.0:1788658460.626014:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025200256 00000100:00100000:2.0:1788658460.626089:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788658460.626099:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025200256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658460.626209:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025200256:12345-0@lo:400:kworker.0 Request processed in 111us (2668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658460.626217:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788658460.626277:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025200256:0@lo:400:kworker.0 00000100:00080000:3.0:1788658460.626808:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658460.626817:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658460.626821:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658460.626823:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658461.119695:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658461.119747:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025201408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658461.119910:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658461.120030:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025201408 00000100:00100000:3.0:1788658461.120040:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025201408 00000100:00100000:3.0:1788658461.120753:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788658461.120769:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025201408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658461.121293:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658461.121385:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025201408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 620us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658461.121394:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:3.0:1788658461.121455:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e84430700 x1875544025201408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658461.121481:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025201408:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788658461.129110:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658461.129299:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658461.129328:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025201536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658461.129427:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658461.129681:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025201536 00000100:00100000:3.0:1788658461.129693:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025201536 00000100:00100000:3.0:1788658461.129791:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788658461.129804:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025201536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658461.129846:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658461.129909:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025201536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658461.129944:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1788658461.129998:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebd9c8000 x1875544025201536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658461.130023:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025201536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658461.639830:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658461.639853:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025201664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658461.639936:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658461.640006:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025201664 00000100:00100000:2.0:1788658461.640014:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025201664 00000100:00100000:2.0:1788658461.640075:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788658461.640084:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025201664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658461.640120:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788658461.640193:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025201664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658461.640201:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788658461.640249:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025201664:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788658462.144221:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658462.906169:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658462.906217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658462.906249:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658462.906269:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658462.906294:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658462.908841:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000987520 00000100:00100000:3.0:1788658462.908863:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000987520 00000100:00080000:0.0:1788658462.908929:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658462.909014:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000987264 00000100:00100000:1.0:1788658462.909019:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000987264 00000100:00100000:1.0:1788658462.909066:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 380 00000100:00100000:1.0:1788658462.909079:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e915d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544000987264:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658462.909193:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e915d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544000987264:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 117us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658462.909202:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 380 00000100:00100000:2.0:1788658462.910910:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000987776 00000100:00100000:2.0:1788658462.910929:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000987776 00000100:00100000:2.0:1788658462.910999:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000987648 00000100:00100000:1.0:1788658462.911000:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000987392 00000100:00100000:2.0:1788658462.911002:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000987648 00000100:00100000:1.0:1788658462.911004:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000987392 00000100:00100000:2.0:1788658462.911024:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 289 00000100:00100000:2.0:1788658462.911034:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000987520:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658462.911125:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 290 00000100:00100000:1.0:1788658462.911134:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544000987776:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658462.911177:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544000987776:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 44us (4926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658462.911186:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 290 00000100:00100000:1.0:1788658462.911204:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 291 00000100:00100000:1.0:1788658462.911210:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544000987648:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658462.911235:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544000987648:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (4940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658462.911250:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 291 00000100:00100000:1.0:1788658462.911262:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 292 00000100:00100000:1.0:1788658462.911269:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000987392:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658462.911312:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000987392:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 43us (5042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658462.911319:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 292 00000100:00080000:0.0:1788658462.911637:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658462.911641:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658462.912065:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544000987520:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 1029us (5844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658462.912073:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 289 00000001:02000400:0.0:1788658462.952334:0:14077:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:34:21 (1788658461) 00010000:00010000:3.0:1788658463.166948:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658464.191050:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658464.191232:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658464.196367:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025201792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658464.196491:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658464.199284:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025201792 00000100:00100000:3.0:1788658464.199307:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025201792 00000100:00100000:3.0:1788658464.199403:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788658464.199417:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025201792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658464.200406:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658464.200753:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025201792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1337us (4260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658464.200764:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788658464.200863:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025201792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658464.742908:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658464.743006:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000987904 00000100:00100000:1.0:1788658464.743020:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000987904 00000100:00100000:1.0:1788658464.743118:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:1.0:1788658464.743132:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:11076:x1875544000987904:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658464.743161:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658464.743195:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6eba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc710 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658464.743359:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788658464.743395:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ebb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658464.743410:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ebb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658464.743427:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ebb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658464.743491:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788658464.743495:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658464.743544:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ebb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658464.744396:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6eba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc710 expref: 7 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658464.744428:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ebb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc710 expref: 6 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658464.744439:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0100) 00010000:00010000:1.0:1788658464.744442:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658464.744448:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419600, rc 0) 00000100:00100000:1.0:1788658464.744598:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:11076:x1875544000987904:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 1462us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658464.744608:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:2.0:1788658464.766048:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658464.766411:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000988032 00000100:00100000:0.0:1788658464.766427:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000988032 00000100:00100000:0.0:1788658464.766526:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:0.0:1788658464.766540:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:11077:x1875544000988032:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658464.766567:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658464.766601:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6ebb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc717 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.766898:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ebbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.766923:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ebbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.766939:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ebbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.766960:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ebc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.766968:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ebc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.766973:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ebc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767063:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6ebcc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767072:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6ebcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767078:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6ebcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658464.767130:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788658464.767135:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658464.767164:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6ebcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767176:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ebbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767183:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ebbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767191:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ebbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767197:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658464.767203:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ebbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767213:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ebbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767227:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0100) 00010000:00010000:0.0:1788658464.767237:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658464.767244:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ebbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767252:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6ebbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767270:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ebc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767277:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ebc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767283:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ebc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767288:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658464.767291:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ebc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767297:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ebc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767305:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a1e90e70300) 00010000:00010000:0.0:1788658464.767307:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658464.767311:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ebc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767317:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6ebc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767359:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6ebb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc717 expref: 8 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767391:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6ebcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc717 expref: 7 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658464.767399:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1e90e70000) 00010000:00010000:0.0:1788658464.767401:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658464.767404:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391800, rc 0) 00000100:00100000:0.0:1788658464.767513:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:11077:x1875544000988032:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 965us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658464.767522:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:3.0:1788658464.775262:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658464.775485:0:6548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000988160 00000100:00100000:2.0:1788658464.775508:0:6548:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000988160 00000100:00100000:2.0:1788658464.775581:0:6548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1788658464.775595:0:6548:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:11077:x1875544000988160:12345-192.168.202.53@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788658464.775744:0:6548:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:11077:x1875544000988160:12345-192.168.202.53@tcp:900:lhsmtool_posix.0 Request processed in 152us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658464.775753:0:6548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:1.0:1788658464.781028:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658464.781135:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000988416 00000100:00100000:2.0:1788658464.781150:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000988416 00000100:00100000:2.0:1788658464.781238:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:2.0:1788658464.781252:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:11077:x1875544000988416:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658464.781281:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658464.781309:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ebd3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc71e expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.781410:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ebda lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.781450:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ebda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.781461:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ebda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.787477:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ebe1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.787516:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ebe1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.787534:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ebe1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.787839:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0000/0x48e67cc629c6ebe8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.787849:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0000/0x48e67cc629c6ebe8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.787856:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0000/0x48e67cc629c6ebe8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658464.787868:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788658464.787960:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ebda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.787969:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ebda lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.787976:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ebda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.787998:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658464.788002:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ebda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788011:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ebda lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788024:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1e90e70000) 00010000:00010000:2.0:1788658464.788027:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658464.788032:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ebda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788039:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6ebda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788052:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ebe1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788072:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ebe1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788078:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ebe1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788083:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658464.788086:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ebe1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788092:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ebe1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788111:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a1d83403200) 00010000:00010000:2.0:1788658464.788113:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658464.788116:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ebe1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788122:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6ebe1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788412:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6ebd3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc71e expref: 10 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788431:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0000/0x48e67cc629c6ebe8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc71e expref: 9 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658464.788440:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:2.0:1788658464.788443:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658464.788445:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0000, rc 0) 00000100:00100000:2.0:1788658464.788544:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:11077:x1875544000988416:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 7294us (7526us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788658464.788556:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:0.0:1788658464.799214:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658464.799669:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000988544 00000100:00100000:1.0:1788658464.799689:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000988544 00000100:00100000:1.0:1788658464.800119:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:1.0:1788658464.800133:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:11077:x1875544000988544:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788658464.800294:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:11077:x1875544000988544:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 164us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658464.800304:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:3.0:1788658464.802016:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658464.802280:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000988672 00000100:00100000:1.0:1788658464.802291:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000988672 00000100:00100000:1.0:1788658464.802369:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:1.0:1788658464.802381:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:11077:x1875544000988672:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788658464.803233:0:6537:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 802us 00000100:00080000:0.0:1788658464.805631:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658464.829377:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:11077:x1875544000988672:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 23353us (23726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658464.829417:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00010000:00010000:2.0:1788658465.214842:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658465.472288:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788658465.541087:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788658465.727848:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebd9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025201920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658465.727927:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658465.728045:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025201920 00000100:00100000:3.0:1788658465.728055:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025201920 00000100:00100000:3.0:1788658465.728118:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788658465.728127:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025201920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788658465.728161:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658465.728211:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025201920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658465.728227:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1788658465.728376:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658465.728427:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebd9c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025201920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658465.729412:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025202048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658465.729485:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658465.729575:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025202048 00000100:00100000:2.0:1788658465.729587:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025202048 00000100:00100000:2.0:1788658465.729632:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788658465.729639:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025202048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658465.729660:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658465.729736:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025202048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658465.729741:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788658465.729774:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025202048:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788658465.730291:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658465.731920:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025202560:0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.731972:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025202304:0@lo:400:kworker.0 00000100:00100000:2.0:1788658465.732005:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658465.733772:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025202432:0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.740174:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658465.740241:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025202816:0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.740278:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658465.740301:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025203328:0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.740318:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658465.740520:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025202560 00000100:00100000:0.0:1788658465.740530:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025202560 00000100:00100000:0.0:1788658465.740576:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025202304 00000100:00100000:0.0:1788658465.740578:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025202304 00000100:00100000:0.0:1788658465.740586:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025202816 00000100:00100000:0.0:1788658465.740588:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025202816 00000100:00100000:0.0:1788658465.740606:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025203328 00000100:00100000:0.0:1788658465.740608:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025203328 00000100:00100000:0.0:1788658465.740631:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788658465.740638:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025202560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.740683:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025202560:12345-0@lo:400:kworker.0 Request processed in 46us (8683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658465.740689:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788658465.740726:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788658465.740732:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025202304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.740758:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025202304:12345-0@lo:400:kworker.0 Request processed in 27us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658465.740763:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788658465.740772:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788658465.740777:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025202816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.740797:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025202816:12345-0@lo:400:kworker.0 Request processed in 20us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658465.740801:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788658465.740809:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788658465.740814:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025203328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.740832:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025203328:12345-0@lo:400:kworker.0 Request processed in 18us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658465.740850:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788658465.740873:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025202176:0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.740901:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658465.740920:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025202688:0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.740941:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658465.741602:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025202560:0@lo:400:kworker.0 00000100:00100000:2.0:1788658465.741615:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025203072:0@lo:400:kworker.0 00000100:00100000:2.0:1788658465.741664:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658465.741766:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025202176 00000100:00100000:1.0:1788658465.741773:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025202176 00000100:00100000:1.0:1788658465.741815:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788658465.741821:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025202176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658465.741867:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025202176:12345-0@lo:400:kworker.0 Request processed in 46us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658465.741872:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:1.0:1788658465.741900:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658465.741922:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025202304:0@lo:400:kworker.0 00000100:00100000:1.0:1788658465.741931:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025202816:0@lo:400:kworker.0 00000100:00100000:1.0:1788658465.741939:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025203328:0@lo:400:kworker.0 00000100:00100000:3.0:1788658465.742157:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658465.743137:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025202944:0@lo:400:kworker.0 00000100:00100000:3.0:1788658465.743184:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658465.743210:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025203456:0@lo:400:kworker.0 00000100:00100000:3.0:1788658465.743233:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658465.743301:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025202944 00000100:00100000:3.0:1788658465.743307:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025202944 00000100:00100000:3.0:1788658465.743351:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025203456 00000100:00100000:3.0:1788658465.743353:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025203456 00000100:00100000:3.0:1788658465.743370:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788658465.743383:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025202944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658465.743452:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025202944:12345-0@lo:400:kworker.0 Request processed in 75us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658465.743459:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788658465.743475:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1788658465.743479:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025203456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658465.743499:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025203456:12345-0@lo:400:kworker.0 Request processed in 21us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658465.743503:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:3.0:1788658465.743519:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788658465.743561:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2253100 x1875544025202944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658465.743571:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025202944:0@lo:400:kworker.0 00010000:00080000:3.0:1788658465.743577:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2250a80 x1875544025203456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658465.743582:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025203456:0@lo:400:kworker.0 00000100:00100000:1.0:1788658465.743773:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025203072 00000100:00100000:1.0:1788658465.743779:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025203072 00000100:00100000:1.0:1788658465.743815:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788658465.743820:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025203072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658465.743856:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025203072:12345-0@lo:400:kworker.0 Request processed in 37us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658465.743860:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:1.0:1788658465.744015:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2253480 x1875544025203072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658465.744025:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025203072:0@lo:400:kworker.0 00000100:00080000:3.0:1788658465.744099:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658465.745777:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025203200:0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.748240:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658465.748317:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025203200 00000100:00100000:0.0:1788658465.748325:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025203200 00000100:00100000:0.0:1788658465.748397:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788658465.748407:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025203200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658465.748458:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025203200:12345-0@lo:400:kworker.0 Request processed in 53us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658465.748465:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788658465.748493:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658465.749782:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025202688 00000100:00100000:2.0:1788658465.749799:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025202688 00000100:00100000:2.0:1788658465.749852:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025202432 00000100:00100000:2.0:1788658465.749855:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025202432 00000100:00100000:2.0:1788658465.749871:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788658465.749879:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025202688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658465.749969:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025202688:12345-0@lo:400:kworker.0 Request processed in 91us (9027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658465.749973:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788658465.749985:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788658465.749989:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8275f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025202432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658465.750022:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8275f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025202432:12345-0@lo:400:kworker.0 Request processed in 31us (7863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658465.750041:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788658465.751489:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025202432:0@lo:400:kworker.0 00010000:00080000:1.0:1788658465.752821:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2251500 x1875544025203200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658465.752856:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025203200:0@lo:400:kworker.0 00000100:00100000:1.0:1788658465.752891:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025202176:0@lo:400:kworker.0 00000100:00100000:1.0:1788658465.752904:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025202688:0@lo:400:kworker.0 00010000:00010000:3.0:1788658466.239410:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658466.239508:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025203584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658466.239602:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658466.239692:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658466.239699:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025203712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658466.239749:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658466.239790:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025203584 00000100:00100000:1.0:1788658466.239800:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025203584 00000100:00100000:1.0:1788658466.239847:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025203712 00000100:00100000:1.0:1788658466.239851:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025203712 00000100:00100000:1.0:1788658466.240167:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788658466.240182:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025203584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658466.240224:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658466.240284:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025203584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658466.240290:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788658466.240311:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788658466.240316:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025203712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658466.240326:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658466.240360:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025203712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658466.240367:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:1.0:1788658466.240423:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e84433100 x1875544025203712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658466.240445:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025203712:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788658466.240455:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef5180 x1875544025203584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658466.240466:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025203584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658466.751715:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658466.751748:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025203840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658466.751850:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658466.751939:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025203840 00000100:00100000:2.0:1788658466.751950:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025203840 00000100:00100000:2.0:1788658466.752014:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788658466.752024:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025203840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658466.752073:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788658466.752127:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025203840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658466.752134:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788658466.752188:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025203840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658467.262686:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658467.265909:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000988800 00000100:00100000:3.0:1788658467.265921:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000988800 00000100:00100000:3.0:1788658467.266088:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:3.0:1788658467.266101:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:11119:x1875544000988800:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658467.266135:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658467.266158:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ebf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc725 expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266235:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ebfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266250:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ebfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266263:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ebfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266279:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266299:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266306:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266353:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ebfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266374:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ebfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266381:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ebfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266387:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658467.266392:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ebfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266399:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ebfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266411:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0100) 00010000:00010000:3.0:1788658467.266414:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658467.266420:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ebfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266427:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ebfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266440:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266453:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266459:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266464:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658467.266467:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266473:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266481:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a1e88496f00) 00010000:00010000:3.0:1788658467.266484:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658467.266486:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266492:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266534:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ebf6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc725 expref: 10 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266545:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0100) 00010000:00010000:3.0:1788658467.266547:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658467.266551:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ebf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc725 expref: 10 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.266562:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031e00, rc 0) 00000100:00100000:3.0:1788658467.266638:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:11119:x1875544000988800:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 539us (3963us total) trans 0 rc 301/301 00000100:00100000:3.0:1788658467.266645:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00010000:00010000:3.0:1788658467.266816:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658467.268059:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658467.282831:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658467.282946:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000989056 00000100:00100000:3.0:1788658467.282957:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000989056 00000100:00100000:3.0:1788658467.283023:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:3.0:1788658467.283034:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:11119:x1875544000989056:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:3.0:1788658467.283094:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658467.283121:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ebb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc710 expref: 9 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283141:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35f0100) 00010000:00010000:3.0:1788658467.283153:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658467.283225:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec0b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283239:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283250:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283262:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283269:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283275:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283854:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283867:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283875:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658467.283889:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c9d81f2 reply state 0000000012c04513 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283898:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283904:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658467.283907:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658467.283910:0:6537:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788658467.283915:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788658467.283925:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec0b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283931:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec0b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283937:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283942:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658467.283946:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec0b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283965:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec0b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283974:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e88496f00) 00010000:00010000:3.0:1788658467.283977:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658467.283980:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec0b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.283985:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec0b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658467.284004:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c9d81f2 reply state 0000000012c04513 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.284011:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.284016:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a1e88496000) 00010000:00010000:3.0:1788658467.284018:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658467.284020:0:6537:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788658467.284122:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:11119:x1875544000989056:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 1089us (1300us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788658467.284131:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:3.0:1788658467.411064:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658467.411377:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000989184 00000100:00100000:0.0:1788658467.411388:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000989184 00000100:00100000:0.0:1788658467.411451:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:0.0:1788658467.411462:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:11127:x1875544000989184:12345-192.168.202.53@tcp:101:lctl.0 00010000:00010000:0.0:1788658467.411496:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658467.411523:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ec20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc72c expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.411589:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390800/0x48e67cc629c6ec27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.411601:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390800/0x48e67cc629c6ec27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.411612:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390800/0x48e67cc629c6ec27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658467.411657:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788658467.411660:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658467.411740:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390800/0x48e67cc629c6ec27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.411763:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ec20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc72c expref: 12 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.411780:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390800/0x48e67cc629c6ec27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc72c expref: 11 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.411788:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:0.0:1788658467.411791:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658467.411794:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390800, rc 0) 00000100:00100000:0.0:1788658467.411868:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:11127:x1875544000989184:12345-192.168.202.53@tcp:101:lctl.0 Request processed in 409us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658467.411876:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000040:00080000:3.0:1788658467.519414:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788658467.538993:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658467.539128:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000989312 00000100:00100000:3.0:1788658467.539213:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000989312 00000100:00100000:3.0:1788658467.539322:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:3.0:1788658467.539337:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:11133:x1875544000989312:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1788658467.539441:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658467.539466:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc733 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539536:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ec35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539552:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ec35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539565:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ec35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539577:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539583:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539589:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539670:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030c00/0x48e67cc629c6ec43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539679:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030c00/0x48e67cc629c6ec43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539684:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030c00/0x48e67cc629c6ec43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658467.539799:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788658467.539808:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658467.539967:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030c00/0x48e67cc629c6ec43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539980:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ec35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539986:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ec35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539993:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ec35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.539998:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658467.540003:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ec35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.540010:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ec35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.540023:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:3.0:1788658467.540026:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658467.540032:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ec35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.540038:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ec35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.540056:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.540062:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.540078:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.540083:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658467.540086:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.540093:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.540101:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a1e88496000) 00010000:00010000:3.0:1788658467.540103:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658467.540106:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.540112:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.541033:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc733 expref: 13 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.541057:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030c00/0x48e67cc629c6ec43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc733 expref: 12 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.541066:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658467.541069:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788658467.541072:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80030c00, rc 0) 00000100:00100000:3.0:1788658467.542282:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+12:11133:x1875544000989312:12345-192.168.202.53@tcp:101:bash.0 Request processed in 2942us (3291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658467.542310:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:2.0:1788658467.549312:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658467.549402:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000989568 00000100:00100000:1.0:1788658467.549412:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000989568 00000100:00100000:1.0:1788658467.549479:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:1.0:1788658467.549490:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+12:11133:x1875544000989568:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1788658467.549510:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658467.549531:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6ec4a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc73a expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.549640:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6ec51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.549656:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6ec51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.549669:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6ec51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.549883:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.549905:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.549941:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788658467.550447:0:6538:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788658467.550820:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550833:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550842:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550881:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6ec51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550887:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6ec51 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550895:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6ec51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550901:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658467.550906:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6ec51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550914:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6ec51 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550929:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:1.0:1788658467.550932:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658467.550948:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6ec51 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550955:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6ec51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788658467.550970:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000756e8280 reply state 00000000b26da655 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550981:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.550988:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e83b21200) 00010000:00010000:1.0:1788658467.550990:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788658467.550993:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788658467.551035:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6ec4a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc73a expref: 15 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.551050:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc73a expref: 14 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.551057:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e83b21700) 00010000:00010000:1.0:1788658467.551059:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788658467.551061:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418600, rc 0) 00000100:00100000:1.0:1788658467.551154:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:11133:x1875544000989568:12345-192.168.202.53@tcp:101:bash.0 Request processed in 1665us (1852us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788658467.551162:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:1.0:1788658467.555811:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658467.555899:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000989696 00000100:00100000:2.0:1788658467.555912:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000989696 00000100:00100000:2.0:1788658467.555964:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:2.0:1788658467.555973:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875544000989696:12345-192.168.202.53@tcp:8:bash.0 00010000:00080000:0.0:1788658467.556120:0:8452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp t0 exp 0000000000000000 cur 384 last 0 00000020:00000080:0.0:1788658467.556163:0:8452:0:(genops.c:1385:class_connect()) connect: client 8cbe5c26-08aa-4214-8c09-2005fb4b10e9, cookie 0x48e67cc629c6ec6d 00002000:00100000:0.0:1788658467.556175:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8cbe5c26-08aa-4214-8c09-2005fb4b10e9/ffff8a1d83705800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658467.556195:0:8452:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658467.556279:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788658467.556313:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8a1d83703800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658467.556386:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2395:x1875544000989696:12345-192.168.202.53@tcp:8:bash.0 Request processed in 412us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658467.556395:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:2.0:1788658467.563475:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658467.568335:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000989824 00000100:00100000:1.0:1788658467.568353:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000989824 00000100:00100000:1.0:1788658467.568522:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:1.0:1788658467.568535:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:0:x1875544000989824:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1788658467.568554:0:10365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658467.568583:0:10365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6ec74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc741 expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658467.568609:0:10365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658467.568629:0:10365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1788658467.568633:0:10365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658467.568642:0:10365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6ec74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc741 expref: 7 pid: 10365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.568663:0:10365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6ec74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc741 expref: 7 pid: 10365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.568677:0:10365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418800, rc 0) 00000100:00100000:1.0:1788658467.568770:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:0:x1875544000989824:12345-192.168.202.53@tcp:101:bash.0 Request processed in 238us (5305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658467.568777:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00080000:0.0:1788658467.572747:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658467.578598:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658467.578849:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000989952 00000100:00100000:0.0:1788658467.578861:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000989952 00000100:00100000:0.0:1788658467.578997:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:0.0:1788658467.579009:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:11133:x1875544000989952:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658467.579029:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658467.579053:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc748 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.579083:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6ec74 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc741 expref: 8 pid: 10365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.579093:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658467.579097:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658467.579102:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.579141:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6ec74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc741 expref: 8 pid: 10365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.579155:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6ec74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc741 expref: 8 pid: 10365 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658467.579170:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8453:1875544025203968:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658467.579316:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8362ab40 going to sleep for 11 seconds 00000040:00080000:2.0:1788658467.583475:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658467.589651:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8453:1875544025203968:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658467.589691:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.589773:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390400, rc 0) 00000100:00100000:0.0:1788658467.589839:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:11133:x1875544000989952:12345-192.168.202.53@tcp:101:bash.0 Request processed in 10832us (11250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658467.589850:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:2.0:1788658467.594416:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658467.594509:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000990080 00000100:00100000:3.0:1788658467.594522:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000990080 00010000:00010000:3.0:1788658467.594567:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6ec74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc741 expref: 8 pid: 10365 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658467.594622:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:3.0:1788658467.594633:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2397:x1875544000990080:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658467.594649:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658467.594673:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6ec74 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc741 expref: 8 pid: 10365 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.594688:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6ec74 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc741 expref: 8 pid: 10365 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.594752:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6ec74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc741 expref: 8 pid: 10365 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.594772:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658467.594777:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658467.594786:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.594797:0:9539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.594871:0:9539:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658467.594887:0:9539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1875544025204096:192.168.202.53@tcp:105: 00000100:00100000:3.0:1788658467.594969:0:9539:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658467.602506:0:9539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1875544025204096:192.168.202.53@tcp:105: 00010000:00010000:3.0:1788658467.602537:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658467.602600:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84dbb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544000990080:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 7967us (8198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658467.602611:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:0.0:1788658467.607587:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658467.608002:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000990336 00000100:00100000:2.0:1788658467.608029:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000990336 00000100:00100000:2.0:1788658467.608104:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1788658467.608115:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:11133:x1875544000990336:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1788658467.608449:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:11133:x1875544000990336:12345-192.168.202.53@tcp:35:bash.0 Request processed in 336us (872us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788658467.608474:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1788658467.740937:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658467.741064:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000990592 00000100:00100000:3.0:1788658467.741075:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000990592 00000100:00100000:3.0:1788658467.741231:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:3.0:1788658467.741243:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:11143:x1875544000990592:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658467.741270:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658467.741296:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc74f expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658467.741419:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788658467.741526:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc74f expref: 18 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.741542:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:3.0:1788658467.741545:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658467.741566:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc74f expref: 18 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.741584:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031e00, rc 0) 00000100:00100000:3.0:1788658467.741661:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:11143:x1875544000990592:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 420us (735us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788658467.741668:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:1.0:1788658467.754474:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658467.754594:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000990848 00000100:00100000:2.0:1788658467.754606:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000990848 00000100:00100000:2.0:1788658467.754719:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1788658467.754731:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:11143:x1875544000990848:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1788658467.755024:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:11143:x1875544000990848:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 295us (561us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788658467.755032:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:1.0:1788658467.867263:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658467.867360:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000990976 00000100:00100000:3.0:1788658467.867372:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000990976 00000100:00100000:3.0:1788658467.867509:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:3.0:1788658467.867522:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:11149:x1875544000990976:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658467.867548:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658467.867569:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc756 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.867634:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.867648:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.867662:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658467.867736:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788658467.867740:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658467.867760:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.867787:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ec90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc756 expref: 20 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.867826:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc756 expref: 19 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.867835:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658467.867839:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658467.867844:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031a00, rc 0) 00000100:00100000:3.0:1788658467.867909:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11149:x1875544000990976:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 389us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658467.867916:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:2.0:1788658467.896161:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658467.897770:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000991232 00000100:00100000:1.0:1788658467.897783:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000991232 00000100:00100000:1.0:1788658467.897859:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:1.0:1788658467.897869:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11149:x1875544000991232:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1788658467.897891:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658467.897929:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6ec9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc75d expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.898042:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eca5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.898058:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.898070:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eca5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658467.898082:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788658467.898693:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6ec9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc75d expref: 22 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.898751:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eca5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc75d expref: 21 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.898762:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e83b21700) 00010000:00010000:1.0:1788658467.898765:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788658467.898768:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418c00, rc 0) 00000100:00100000:1.0:1788658467.898845:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:11149:x1875544000991232:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 976us (2705us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788658467.898854:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:1.0:1788658467.905000:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658467.905044:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658467.905115:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000991616 00000100:00100000:3.0:1788658467.905126:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000991616 00000100:00100000:3.0:1788658467.905201:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:3.0:1788658467.905221:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:11149:x1875544000991616:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658467.905245:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658467.905266:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecb3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc764 expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.905376:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ecba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.905392:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ecba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.905404:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ecba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658467.905417:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788658467.905552:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecb3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc764 expref: 24 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.905572:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ecba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc764 expref: 23 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.905581:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e83b21700) 00010000:00010000:3.0:1788658467.905584:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788658467.905588:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031600, rc 0) 00000100:00100000:3.0:1788658467.905733:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:11149:x1875544000991616:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 492us (657us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788658467.905741:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:2.0:1788658467.906019:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000991360 00000100:00100000:2.0:1788658467.906025:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000991360 00000100:00100000:2.0:1788658467.906069:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:2.0:1788658467.906078:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:2396:x1875544000991360:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658467.906089:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658467.906104:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6eca5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc75d expref: 23 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658467.906115:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e83b21700) 00010000:00010000:2.0:1788658467.906119:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658467.906152:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:2396:x1875544000991360:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 65us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658467.906167:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:2.0:1788658467.918414:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658467.918650:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000991744 00000100:00100000:0.0:1788658467.918661:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000991744 00000100:00100000:0.0:1788658467.918760:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:0.0:1788658467.918772:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544000991744:12345-192.168.202.53@tcp:1:lfs.0 00010000:00010000:0.0:1788658467.918816:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.918837:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.918845:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788658467.918849:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658467.918853:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.918890:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.918904:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 7 pid: 8453 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658467.918939:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8452:1875544025204224:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658467.919026:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8362ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658467.928443:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658467.928638:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000991872 00000100:00100000:2.0:1788658467.928654:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000991872 00002000:00100000:2.0:1788658467.928754:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8a1eb2252d80 x1875544000991872/t0(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:58/0 lens 504/0 e 0 to 0 dl 1788658478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788658467.928767:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1eb2252d80 with x1875544000991872 ext(0->12) 00010000:00010000:2.0:1788658467.928778:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 8 pid: 8453 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658467.928797:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 8 pid: 8453 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658467.928806:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a1eb2252d80 00000100:00100000:2.0:1788658467.928884:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:2.0:1788658467.928897:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2397:x1875544000991872:12345-192.168.202.53@tcp:4:lfs.0 00000100:00100000:0.0:1788658467.930563:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8452:1875544025204224:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658467.930603:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788658467.934558:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000100:00100000:1.0:1788658467.935825:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2397:x1875544000991872:12345-192.168.202.53@tcp:4:lfs.0 Request processed in 6921us (7391us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788658467.935853:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00002000:00100000:1.0:1788658467.935866:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8a1eb2252d80 x1875544000991872/t4294967300(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:58/0 lens 504/448 e 0 to 0 dl 1788658478 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788658467.935876:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1eb2252d80 with x1875544000991872 ext(0->12) 00010000:00010000:1.0:1788658467.935887:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 9 pid: 8453 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.935905:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 9 pid: 8453 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658467.935912:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a1eb2252d80 00000100:00100000:2.0:1788658467.945890:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658467.946264:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000992000 00000100:00100000:1.0:1788658467.946275:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000992000 00010000:00010000:1.0:1788658467.946321:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 9 pid: 8453 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658467.946363:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:1.0:1788658467.946372:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2396:x1875544000992000:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658467.946389:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788658467.946408:0:6521:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788658467.946411:0:6521:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788658467 00002000:00010000:1.0:1788658467.946414:0:6521:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788658467 00002000:00010000:1.0:1788658467.946415:0:6521:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788658467 00002000:00010000:1.0:1788658467.946417:0:6521:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788658467.946423:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 9 pid: 8453 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.946453:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 9 pid: 8453 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.946556:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000df96bd8/0x48e67cc629c6ec7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc748 expref: 9 pid: 8453 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.946574:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658467.946588:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658467.946595:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.946605:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.946679:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658467.946777:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544000992000:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 405us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658467.946786:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00010000:00010000:0.0:1788658467.953697:0:8452:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.953744:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.953779:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.953788:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.953796:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.953803:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658467.953807:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.953838:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.953861:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.953870:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6ecc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658467.953991:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544000991744:12345-192.168.202.53@tcp:1:lfs.0 Request processed in 35217us (35583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658467.954002:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:2.0:1788658467.957419:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658467.962344:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000992256 00000100:00100000:3.0:1788658467.962359:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000992256 00000100:00100000:3.0:1788658467.962436:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1788658467.962446:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11149:x1875544000992256:12345-192.168.202.53@tcp:35:lfs.0 00000004:00010000:3.0:1788658467.964304:0:6539:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ecba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc764 expref: 22 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658467.964570:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788658467.964621:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788658467.964972:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788658467.965015:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.965031:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc73a expref: 26 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.965040:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.965084:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc73a expref: 26 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.965101:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc73a expref: 26 pid: 6538 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658467.965117:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6539:1875544025204352:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658467.965260:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658467.968786:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6539:1875544025204352:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658467.968818:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658467.970078:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658467.970359:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000992384 00000100:00100000:3.0:1788658467.970370:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000992384 00010000:00010000:3.0:1788658467.970413:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc73a expref: 27 pid: 6538 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658467.970459:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:3.0:1788658467.970647:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:2397:x1875544000992384:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658467.970668:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658467.970677:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc73a expref: 27 pid: 6538 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.970690:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc73a expref: 27 pid: 6538 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.970879:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ec5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc73a expref: 27 pid: 6538 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.970894:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e83b21700) 00010000:00010000:3.0:1788658467.970900:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.970908:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.970916:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658467.970987:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658467.971050:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:2397:x1875544000992384:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 581us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658467.971059:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00010000:00010000:2.0:1788658467.975127:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658467.975283:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658467.975416:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1788658467.975782:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788658467.975881:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875544025204480:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788658467.975948:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658467.976057:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead8f5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658467.976107:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025204480 00000100:00100000:1.0:1788658467.976115:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025204480 00000100:00100000:1.0:1788658467.976248:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788658467.976258:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6539:x1875544025204480:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788658467.976384:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6539:x1875544025204480:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 127us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658467.976392:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1788658467.979446:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658467.980307:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f7800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875544025204480:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788658467.981032:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788658467.981122:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875544025204608:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788658467.981349:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658467.981436:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead8f5900 going to sleep for 11 seconds 00000100:00100000:0.0:1788658467.981546:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025204608 00000100:00100000:0.0:1788658467.981554:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025204608 00000100:00100000:0.0:1788658467.981842:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788658467.981854:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6539:x1875544025204608:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788658467.982037:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6539:x1875544025204608:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 185us (688us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788658467.982046:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788658467.982167:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875544025204608:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788658467.982463:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788658467.982669:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.982679:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.982687:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.982693:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658467.982879:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.982890:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.982906:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e83b21700) 00010000:00010000:1.0:1788658467.982910:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788658467.982915:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658467.982920:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6eccf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788658467.983034:0:6539:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788658467.983095:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788658467.983106:0:6539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385199403009ns, next at 386199400561ns, rc = 0 00000001:00080000:1.0:1788658467.983114:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788658467.983154:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e83b21700) 00010000:00010000:1.0:1788658467.983157:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788658467.983165:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ecba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc764 expref: 30 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658467.983365:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:11149:x1875544000992256:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 20919us (25958us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788658467.983375:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000020:00080000:1.0:1788658467.983380:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788658467.988096:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658467.988321:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000992512 00000100:00100000:0.0:1788658467.988331:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000992512 00000100:00100000:0.0:1788658467.988437:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:0.0:1788658467.988451:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:11149:x1875544000992512:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658467.988489:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658467.988531:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ecd6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc76b expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.988599:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ecd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc76b expref: 30 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.988613:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ecd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc76b expref: 30 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658467.988632:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658467.988636:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658467.988639:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391a00, rc 0) 00000100:00100000:0.0:1788658467.988768:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11149:x1875544000992512:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 321us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658467.988775:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:2.0:1788658467.998891:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658467.999679:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000992768 00000100:00100000:1.0:1788658467.999690:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000992768 00000100:00100000:1.0:1788658467.999889:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:1.0:1788658467.999901:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb54050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11149:x1875544000992768:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658468.000174:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb54050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:11149:x1875544000992768:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 275us (1293us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788658468.000183:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:2.0:1788658468.033660:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658468.033798:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658468.033824:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658468.033856:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658468.033879:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658468.033952:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000993408 00000100:00100000:3.0:1788658468.033963:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000993408 00000100:00100000:3.0:1788658468.034042:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000993024 00000100:00100000:3.0:1788658468.034045:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000993024 00000100:00100000:3.0:1788658468.034066:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000993280 00000100:00100000:3.0:1788658468.034069:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000993280 00000100:00100000:3.0:1788658468.034099:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 299 00000100:00100000:3.0:1788658468.034113:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000993408:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658468.034215:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000993408:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 106us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658468.034236:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 299 00000100:00100000:3.0:1788658468.034256:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 300 00000100:00100000:3.0:1788658468.034263:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000993024:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658468.034290:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544000993024:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658468.034296:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 300 00000100:00100000:3.0:1788658468.034307:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 301 00000100:00100000:3.0:1788658468.034313:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000993280:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658468.034338:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544000993280:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658468.034344:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 301 00000100:00080000:2.0:1788658468.038501:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658468.038513:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658468.041383:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000993152 00000100:00100000:0.0:1788658468.041399:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000993152 00000100:00100000:0.0:1788658468.041489:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 104 00000100:00100000:0.0:1788658468.041500:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2399:x1875544000993152:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658468.041601:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2399:x1875544000993152:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 101us (7801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658468.041608:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 104 00000100:00100000:1.0:1788658468.046670:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000992896 00000100:00100000:1.0:1788658468.046687:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000992896 00000100:00100000:1.0:1788658468.046782:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 382 00000100:00100000:1.0:1788658468.046793:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544000992896:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658468.046881:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544000992896:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 90us (13231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658468.046889:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 382 00000100:00100000:3.0:1788658468.140307:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658468.140940:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000993664 00000100:00100000:0.0:1788658468.140952:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000993664 00000100:00100000:0.0:1788658468.141253:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:0.0:1788658468.141264:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:11159:x1875544000993664:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658468.141290:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658468.141326:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ecdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc772 expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658468.141429:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788658468.142284:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ecdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc772 expref: 33 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.142301:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:0.0:1788658468.142305:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658468.142310:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ecdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc772 expref: 33 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.142326:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391c00, rc 0) 00000100:00100000:0.0:1788658468.142743:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:11159:x1875544000993664:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1478us (2445us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788658468.142752:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:2.0:1788658468.149919:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658468.150252:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000993792 00000100:00100000:3.0:1788658468.150265:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000993792 00000100:00100000:3.0:1788658468.150366:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:3.0:1788658468.150590:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:11159:x1875544000993792:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:3.0:1788658468.150668:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eceb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150684:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eceb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150696:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eceb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150788:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150811:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150819:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150895:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150903:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150910:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658468.150961:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150974:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eceb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150982:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eceb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150988:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eceb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.150994:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658468.150998:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eceb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151007:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eceb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151042:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658468.151045:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658468.151050:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eceb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151057:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eceb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151083:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151088:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecf2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151094:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151098:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658468.151101:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151106:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151125:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e83b21200) 00010000:00010000:3.0:1788658468.151128:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658468.151131:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecf2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151136:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ecf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151159:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151165:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151169:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151174:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658468.151176:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151193:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151200:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:3.0:1788658468.151203:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658468.151206:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.151211:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ecf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658468.151348:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:11159:x1875544000993792:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 971us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658468.151361:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:2.0:1788658468.161321:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658468.161599:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000994048 00000100:00100000:1.0:1788658468.161610:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000994048 00000100:00100000:1.0:1788658468.161671:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:1.0:1788658468.161683:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:11159:x1875544000994048:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658468.161932:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+33:11159:x1875544000994048:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 250us (623us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788658468.161958:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:2.0:1788658468.232217:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658468.232333:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000994304 00000100:00100000:0.0:1788658468.232344:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000994304 00000100:00100000:0.0:1788658468.232912:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1788658468.232925:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+33:11162:x1875544000994304:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658468.232951:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658468.232975:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc779 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.233051:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed07 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.233067:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.233095:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.233127:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.233136:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.233143:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.233277:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.233287:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.233294:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658468.233304:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788658468.234682:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234698:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed07 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234844:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234850:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658468.234870:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234879:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234896:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658468.234899:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658468.234905:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234910:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234926:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234932:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234937:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234942:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658468.234944:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234950:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234956:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e83b21200) 00010000:00010000:0.0:1788658468.234958:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658468.234970:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.234975:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.235041:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc779 expref: 36 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.235057:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc779 expref: 35 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.235065:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658468.235067:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658468.235069:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390a00, rc 0) 00000100:00100000:0.0:1788658468.235289:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:11162:x1875544000994304:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 2365us (3081us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788658468.235299:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:3.0:1788658468.240932:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658468.241021:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000994432 00000100:00100000:0.0:1788658468.241031:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000994432 00000100:00100000:0.0:1788658468.241109:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:0.0:1788658468.241120:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:11162:x1875544000994432:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:0.0:1788658468.241193:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.241210:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.241225:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.241283:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.241290:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.241296:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.241302:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658468.241306:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.241313:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.241326:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658468.241328:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658468.241332:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.241338:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658468.241426:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:11162:x1875544000994432:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 307us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658468.241434:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:2.0:1788658468.244927:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658468.245022:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000994688 00000100:00100000:1.0:1788658468.245032:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000994688 00000100:00100000:1.0:1788658468.245093:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:1.0:1788658468.245114:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:11162:x1875544000994688:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658468.245361:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+36:11162:x1875544000994688:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 258us (443us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788658468.245369:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00010000:00010000:2.0:1788658468.292029:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658468.578592:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658468.578740:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000994944 00000100:00100000:0.0:1788658468.578750:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000994944 00000100:00100000:0.0:1788658468.578816:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:0.0:1788658468.578843:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+36:11193:x1875544000994944:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:0.0:1788658468.578870:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658468.578892:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc780 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.578994:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.579009:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.579035:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658468.579046:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788658468.579187:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc780 expref: 39 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.579207:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc780 expref: 38 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.579215:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658468.579218:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658468.579222:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391c00, rc 0) 00000100:00100000:0.0:1788658468.579341:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:11193:x1875544000994944:12345-192.168.202.53@tcp:101:cat.0 Request processed in 500us (759us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788658468.579348:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:3.0:1788658468.590522:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658468.590739:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000995200 00000100:00100000:2.0:1788658468.590750:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000995200 00000100:00100000:2.0:1788658468.590815:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1788658468.590825:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:11193:x1875544000995200:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:2.0:1788658468.591534:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:11193:x1875544000995200:12345-192.168.202.53@tcp:35:cat.0 Request processed in 707us (1019us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788658468.591544:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1788658468.593946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658468.594039:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000995328 00000100:00100000:1.0:1788658468.594050:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000995328 00000100:00100000:1.0:1788658468.594128:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:1.0:1788658468.594138:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:2397:x1875544000995328:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658468.594156:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658468.594188:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc780 expref: 39 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658468.594208:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:1.0:1788658468.594215:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658468.594280:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:2397:x1875544000995328:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 143us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658468.594288:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:3.0:1788658468.759778:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658468.760411:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000995584 00000100:00100000:0.0:1788658468.760423:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000995584 00000100:00100000:0.0:1788658468.760512:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:0.0:1788658468.760522:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:11199:x1875544000995584:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:0.0:1788658468.760549:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658468.760552:0:11974:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788658468.760581:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6ec97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc756 expref: 38 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.760605:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658468.760611:0:11974:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658468.760624:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed3f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc787 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.760780:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.760795:0:11974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc779 expref: 38 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.760803:0:11974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.760835:0:11974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc779 expref: 38 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.760849:0:11974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc779 expref: 38 pid: 11974 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658468.760863:0:11974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025204736:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658468.760973:0:11974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8362ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658468.779320:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658468.779484:0:11974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025204736:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658468.779513:0:11974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658468.784463:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000995712 00000100:00100000:3.0:1788658468.784480:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000995712 00010000:00010000:3.0:1788658468.784533:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc779 expref: 39 pid: 11974 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658468.784652:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:3.0:1788658468.784663:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:2399:x1875544000995712:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658468.784680:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658468.784688:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc779 expref: 39 pid: 11974 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.784720:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc779 expref: 39 pid: 11974 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.784747:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc779 expref: 39 pid: 11974 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.784764:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:3.0:1788658468.784768:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.784777:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.784784:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.784808:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658468.784898:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:2399:x1875544000995712:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 236us (5587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658468.784906:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00010000:00010000:0.0:1788658468.784978:0:11974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.784998:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658468.785021:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788658468.785197:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed3f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc787 expref: 39 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.785225:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc787 expref: 38 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658468.785233:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658468.785236:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658468.785239:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390400, rc 0) 00000100:00100000:0.0:1788658468.785267:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:11199:x1875544000995584:12345-192.168.202.53@tcp:101:dd.0 Request processed in 24747us (25501us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788658468.785274:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:2.0:1788658468.799726:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658468.800891:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000995840 00000100:00100000:3.0:1788658468.800905:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000995840 00000100:00100000:3.0:1788658468.800971:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:3.0:1788658468.800982:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:11199:x1875544000995840:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:3.0:1788658468.801008:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658468.801032:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ed54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc78e expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.801081:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.801097:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.801120:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.801256:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ed54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc78e expref: 40 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.801278:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc78e expref: 39 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.801286:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:3.0:1788658468.801289:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658468.801293:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80030200, rc 0) 00000100:00100000:3.0:1788658468.801369:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:11199:x1875544000995840:12345-192.168.202.53@tcp:101:dd.0 Request processed in 388us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658468.801747:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:1.0:1788658468.806209:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658468.807065:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000996096 00000100:00100000:3.0:1788658468.807077:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000996096 00000100:00100000:3.0:1788658468.807147:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:3.0:1788658468.807158:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:11199:x1875544000996096:12345-192.168.202.53@tcp:36:dd.0 00010000:00010000:3.0:1788658468.807753:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.807773:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.807786:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658468.807830:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788658468.807851:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005de05aca reply state 00000000331259fe transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.807862:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658468.807869:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:3.0:1788658468.807872:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658468.807876:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658468.808193:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+42:11199:x1875544000996096:12345-192.168.202.53@tcp:36:dd.0 Request processed in 1035us (2003us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788658468.808211:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 62 00000020:00080000:3.0:1788658468.808217:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788658469.246006:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658469.246471:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000996224 00000100:00100000:0.0:1788658469.246482:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000996224 00000100:00100000:0.0:1788658469.246568:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:0.0:1788658469.246579:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+42:11214:x1875544000996224:12345-192.168.202.53@tcp:101:stat.0 00010000:00010000:0.0:1788658469.246618:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658469.246639:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc795 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.246858:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed70 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.246873:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.246891:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.246902:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.246909:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.246916:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.247180:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.247193:0:11974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc787 expref: 43 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.247202:0:11974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.247238:0:11974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc787 expref: 43 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.247258:0:11974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc787 expref: 43 pid: 11974 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658469.247464:0:11974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025204864:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658469.247824:0:11974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8362ab40 going to sleep for 11 seconds 00000100:00080000:2.0:1788658469.247892:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658469.273829:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658469.274019:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000996480 00000100:00100000:1.0:1788658469.274028:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000996480 00000100:00100000:1.0:1788658469.274085:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1788658469.274096:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+44:6168:x1875544000996480:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788658469.274445:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+45:6168:x1875544000996480:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 349us (624us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788658469.274453:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:0.0:1788658469.275057:0:11974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831be300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025204864:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658469.275086:0:11974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658469.280686:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658469.283151:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000996608 00000100:00100000:2.0:1788658469.283166:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000996608 00010000:00010000:2.0:1788658469.283221:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc787 expref: 45 pid: 11974 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658469.283283:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:2.0:1788658469.283294:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+45:2397:x1875544000996608:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658469.283310:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658469.283327:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc787 expref: 45 pid: 11974 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.283342:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc787 expref: 45 pid: 11974 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.283363:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ed46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc787 expref: 45 pid: 11974 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.283584:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:2.0:1788658469.283673:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.283683:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.283691:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.283771:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658469.283840:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+44:2397:x1875544000996608:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 547us (3164us total) trans 0 rc 0/0 00010000:00010000:0.0:1788658469.284421:0:11974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284431:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658469.284493:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788658469.284498:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658469.284544:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284557:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284567:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed70 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284574:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed70 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284621:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284626:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658469.284631:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed70 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284639:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed70 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284651:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658469.284654:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658469.284658:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284664:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284678:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284683:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284688:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284692:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658469.284695:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284732:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284741:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e83b21200) 00010000:00010000:0.0:1788658469.284743:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658469.284746:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed77 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284752:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284788:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc795 expref: 45 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284802:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc795 expref: 44 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.284809:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658469.284811:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658469.284813:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391c00, rc 0) 00000100:00100000:0.0:1788658469.284852:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+44:11214:x1875544000996224:12345-192.168.202.53@tcp:101:stat.0 Request processed in 38275us (38864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658469.284861:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:2.0:1788658469.288087:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:2.0:1788658469.311440:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025204992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658469.311538:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658469.311693:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658469.311908:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025204992 00000100:00100000:0.0:1788658469.311917:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025204992 00000100:00100000:0.0:1788658469.311998:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788658469.312007:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025204992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658469.312056:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788658469.317419:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025204992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5400us (5868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658469.317434:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788658469.322288:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025204992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658469.454442:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658469.454619:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000996864 00000100:00100000:1.0:1788658469.454637:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000996864 00000100:00100000:1.0:1788658469.455695:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:1.0:1788658469.455729:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:11220:x1875544000996864:12345-192.168.202.53@tcp:36:truncate.0 00010000:00010000:1.0:1788658469.455797:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658469.455827:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ed7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc795 expref: 43 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658469.455849:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:1.0:1788658469.455854:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658469.461780:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658469.461806:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658469.461819:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658469.461874:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1788658469.461901:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8b8cef9 reply state 0000000095d19f1a transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658469.461913:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658469.461937:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:1.0:1788658469.461940:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788658469.461945:0:6537:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788658469.462110:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+45:11220:x1875544000996864:12345-192.168.202.53@tcp:36:truncate.0 Request processed in 6385us (7693us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788658469.462120:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 64 00000020:00080000:1.0:1788658469.462126:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788658469.689305:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658469.689843:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000996992 00000100:00100000:0.0:1788658469.689857:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000996992 00000100:00100000:0.0:1788658469.689955:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:0.0:1788658469.689968:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+45:11234:x1875544000996992:12345-192.168.202.53@tcp:101:stat.0 00010000:00010000:0.0:1788658469.690002:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658469.690032:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc79c expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690141:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690159:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690173:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690186:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690194:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690201:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690293:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690317:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690325:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658469.690379:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788658469.690384:0:7958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658469.690408:0:7958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690422:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690431:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690438:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690445:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690450:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658469.690455:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690463:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690477:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658469.690486:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658469.690492:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690498:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ed93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690514:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690520:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690527:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690531:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658469.690534:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690539:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690545:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e83b21200) 00010000:00010000:0.0:1788658469.690548:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658469.690550:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690555:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ed9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690586:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ed8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc79c expref: 47 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690612:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc79c expref: 46 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.690620:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658469.690622:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658469.690625:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391c00, rc 0) 00000100:00100000:0.0:1788658469.690989:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+46:11234:x1875544000996992:12345-192.168.202.53@tcp:101:stat.0 Request processed in 1021us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658469.690998:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:0.0:1788658469.810771:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658469.811371:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000997248 00000100:00100000:2.0:1788658469.811387:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000997248 00000100:00100000:2.0:1788658469.811470:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:2.0:1788658469.811484:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+46:11244:x1875544000997248:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658469.811517:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658469.811543:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6eda8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7a3 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658469.811698:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788658469.811934:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6eda8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7a3 expref: 48 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.811957:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:2.0:1788658469.811962:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658469.812002:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6eda8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7a3 expref: 48 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.812044:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1400, rc 0) 00000100:00100000:2.0:1788658469.812169:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+47:11244:x1875544000997248:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 684us (1409us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788658469.812182:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:3.0:1788658469.817491:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000001:00080000:1.0:1788658469.818387:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000004:00080000:1.0:1788658469.818443:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788658469.818472:0:6515:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1d8351d600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788658469.818478:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d835ff300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1d8351de40 00000020:00080000:1.0:1788658469.818482:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d835ffe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1d83169400 00000100:00100000:1.0:1788658469.818673:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025205120:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788658469.818780:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788658469.819145:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788658469.819603:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1788658469.819699:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819725:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819733:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819739:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658469.819745:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819753:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819776:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a1e88496000) 00010000:00010000:3.0:1788658469.819779:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658469.819784:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819789:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ec12 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819813:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819939:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819943:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819946:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658469.819948:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819952:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819958:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658469.819960:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658469.819962:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819966:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ec19 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819979:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819983:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819986:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.819990:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658469.819996:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820001:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820005:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e83b21200) 00010000:00010000:3.0:1788658469.820006:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658469.820009:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820014:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ec58 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820035:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820041:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820046:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820051:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658469.820054:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820059:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820068:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:3.0:1788658469.820070:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658469.820082:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820088:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ed62 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820097:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820101:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820105:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820108:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658469.820109:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820113:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820117:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:3.0:1788658469.820118:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658469.820120:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.820123:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6ed85 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658469.820785:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025205120 00000100:00100000:1.0:1788658469.820802:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000997504 00000100:00100000:0.0:1788658469.820802:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025205120 00000100:00100000:1.0:1788658469.820808:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000997504 00000100:00100000:0.0:1788658469.820892:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788658469.820912:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025205120:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788658469.820957:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:1.0:1788658469.820966:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+12:11244:x1875544000997504:12345-192.168.202.53@tcp:35:lfs.0 00002000:00080000:0.0:1788658469.820977:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1788658469.821048:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9cc323, atime: 0x6a9cc323, ctime: 0x6a9cc323, blocks: 0x8 00010000:00010000:0.0:1788658469.821063:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6edb6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.821086:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=387s v=(0 0) 00010000:00010000:0.0:1788658469.821093:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658469.821104:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6edb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.821132:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6edb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.821168:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6edb6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.821181:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6edb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.821218:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1788658469.821319:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658469.821498:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1875544025205120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 589us (2713us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788658469.821511:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788658469.821561:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658469.821568:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6edb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.821577:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658469.821582:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6edb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.821591:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6edb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.821608:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6edb6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.821616:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad30064d/0x48e67cc629c6edb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.821644:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658469.821647:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658469.821648:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658469.821678:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:11244:x1875544000997504:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 711us (4201us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1788658469.821687:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000004:00080000:3.0:1788658469.822341:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1eb2251c00/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788658469.822352:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025205120:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788658469.860529:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658469.860605:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000997760 00000100:00100000:1.0:1788658469.860618:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000997760 00000100:00100000:1.0:1788658469.860753:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:1.0:1788658469.860765:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:11250:x1875544000997760:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1788658469.860796:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658469.860831:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c6edbd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7aa expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658469.860984:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658469.860999:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc79c expref: 14 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658469.861008:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658469.861055:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc79c expref: 14 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658469.861071:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc79c expref: 14 pid: 7958 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658469.861085:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025205248:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658469.861352:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658469.865334:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658469.865391:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000997888 00000100:00100000:3.0:1788658469.865404:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000997888 00010000:00010000:3.0:1788658469.865574:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc79c expref: 15 pid: 7958 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658469.865626:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:3.0:1788658469.865638:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:2396:x1875544000997888:12345-192.168.202.53@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788658469.865825:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025205248:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658469.865848:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658469.865856:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc79c expref: 15 pid: 7958 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.865861:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.865870:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc79c expref: 15 pid: 7958 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.865897:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eda1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc79c expref: 15 pid: 7958 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.865930:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:3.0:1788658469.865937:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.865948:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.865957:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.865991:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658469.866062:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84db9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:2396:x1875544000997888:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 427us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658469.866089:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00010000:00010000:2.0:1788658469.866316:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.866324:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658469.866349:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788658469.866530:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c6edbd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7aa expref: 15 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.866545:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7aa expref: 14 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.866551:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:2.0:1788658469.866553:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788658469.866555:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418200, rc 0) 00000100:00100000:2.0:1788658469.866592:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:11250:x1875544000997760:12345-192.168.202.53@tcp:101:bash.0 Request processed in 5829us (6080us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788658469.866610:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:1.0:1788658469.872991:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658469.873361:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000998144 00000100:00100000:3.0:1788658469.873375:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000998144 00000100:00100000:3.0:1788658469.873470:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:3.0:1788658469.873483:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:11250:x1875544000998144:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:3.0:1788658469.873835:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.873858:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.873873:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658469.873940:0:7958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1788658469.873964:0:7958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5dbab78 reply state 00000000e1511abd transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.873979:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.873989:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:3.0:1788658469.873992:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658469.873999:0:7958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658469.874121:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:11250:x1875544000998144:12345-192.168.202.53@tcp:36:bash.0 Request processed in 639us (1146us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788658469.874129:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 68 00000020:00080000:3.0:1788658469.874135:0:7958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788658469.889541:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658469.889689:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000998272 00000100:00100000:2.0:1788658469.889721:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000998272 00000100:00100000:2.0:1788658469.889781:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:2.0:1788658469.889791:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:11250:x1875544000998272:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658469.889820:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658469.889848:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6edd9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7b1 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.889991:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.890266:0:11974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7aa expref: 18 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.890277:0:11974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.890320:0:11974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7aa expref: 18 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658469.890336:0:11974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7aa expref: 18 pid: 6537 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658469.890352:0:11974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025205376:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658469.890521:0:11974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead8f5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788658469.895124:0:11974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025205376:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658469.895165:0:11974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658469.903748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658469.903997:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000998400 00000100:00100000:3.0:1788658469.904031:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000998400 00010000:00010000:3.0:1788658469.904087:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7aa expref: 19 pid: 6537 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658469.904136:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:3.0:1788658469.904149:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:2397:x1875544000998400:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658469.904170:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658469.904177:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7aa expref: 19 pid: 6537 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.904190:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7aa expref: 19 pid: 6537 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.904215:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6edc4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7aa expref: 19 pid: 6537 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.904231:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:3.0:1788658469.904235:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.904245:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.904251:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658469.904277:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658469.904301:0:11974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.904309:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658469.904347:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:2397:x1875544000998400:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 201us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658469.904364:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00000004:00200000:0.0:1788658469.904389:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788658469.904394:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658469.904421:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.904479:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6edd9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7b1 expref: 18 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.904497:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7b1 expref: 17 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658469.904505:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658469.904514:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658469.904518:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0c00, rc 0) 00000100:00100000:0.0:1788658469.904550:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:11250:x1875544000998272:12345-192.168.202.53@tcp:101:bash.0 Request processed in 14760us (15022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658469.904557:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:3.0:1788658469.909862:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658469.910015:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000998656 00000100:00100000:1.0:1788658469.910029:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000998656 00000100:00100000:1.0:1788658469.910103:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:1.0:1788658469.910115:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:11250:x1875544000998656:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:1.0:1788658469.910492:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:11250:x1875544000998656:12345-192.168.202.53@tcp:35:bash.0 Request processed in 379us (645us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788658469.910501:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:1.0:1788658470.031460:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658470.034067:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000998912 00000100:00100000:2.0:1788658470.034117:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000998912 00000100:00100000:2.0:1788658470.034221:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:2.0:1788658470.034236:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:11260:x1875544000998912:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658470.034272:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658470.034303:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ede7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7b8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658470.034462:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788658470.034841:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ede7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7b8 expref: 20 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.034860:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:2.0:1788658470.034864:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658470.034870:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ede7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7b8 expref: 20 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.034888:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1600, rc 0) 00000100:00100000:2.0:1788658470.034993:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11260:x1875544000998912:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 761us (3548us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788658470.035002:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:2.0:1788658470.051748:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.052569:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000999040 00000100:00100000:1.0:1788658470.052585:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000999040 00000100:00100000:1.0:1788658470.052668:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:1.0:1788658470.052678:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11260:x1875544000999040:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:1.0:1788658470.056722:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6edf5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.056768:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6edf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.056799:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6edf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.056844:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6edfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.056852:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6edfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.056859:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6edfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057004:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057016:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057046:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788658470.057130:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057149:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6edf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057157:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6edf5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057165:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6edf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057172:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658470.057366:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6edf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057380:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6edf5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057397:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:1.0:1788658470.057401:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658470.057407:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6edf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057415:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6edf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057432:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6edfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057445:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6edfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057452:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6edfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057457:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658470.057461:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6edfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057468:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6edfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057476:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e83b21700) 00010000:00010000:1.0:1788658470.057479:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658470.057482:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6edfc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057488:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6edfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057507:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057514:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057520:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057526:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658470.057538:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057546:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057554:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:1.0:1788658470.057558:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658470.057561:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.057567:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ee03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658470.057770:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11260:x1875544000999040:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 5020us (5964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.057782:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:3.0:1788658470.065122:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.066009:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000999296 00000100:00100000:1.0:1788658470.066026:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000999296 00000100:00100000:1.0:1788658470.066120:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:1.0:1788658470.066133:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11260:x1875544000999296:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658470.066457:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:11260:x1875544000999296:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 325us (1356us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788658470.066466:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:3.0:1788658470.133433:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.133661:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000999552 00000100:00100000:0.0:1788658470.133676:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000999552 00000100:00100000:0.0:1788658470.133805:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:0.0:1788658470.133817:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:11263:x1875544000999552:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658470.133849:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658470.133876:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ee0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7bf expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.133998:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee11 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134017:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134032:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134048:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134055:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134062:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134217:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ee1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134229:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ee1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134251:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ee1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658470.134264:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788658470.134372:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee11 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134381:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee11 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134389:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee11 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134396:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658470.134401:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee11 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134410:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee11 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134424:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658470.134428:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658470.134434:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134453:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134469:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134476:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134482:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134488:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658470.134492:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134499:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134506:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e70100) 00010000:00010000:0.0:1788658470.134509:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658470.134512:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134519:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134573:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ee0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7bf expref: 23 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134605:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ee1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7bf expref: 22 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.134613:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658470.134616:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658470.134618:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390e00, rc 0) 00000100:00100000:0.0:1788658470.135374:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11263:x1875544000999552:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1552us (1951us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788658470.135387:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:0.0:1788658470.141552:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658470.141655:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000999680 00000100:00100000:2.0:1788658470.141671:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000999680 00000100:00100000:2.0:1788658470.141798:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:2.0:1788658470.141811:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11263:x1875544000999680:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:2.0:1788658470.141914:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ee2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.141957:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ee2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.141972:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ee2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.142021:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ee2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.142042:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ee2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.142050:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ee2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.142056:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658470.142062:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ee2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.142071:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ee2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.142085:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:2.0:1788658470.142088:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658470.142094:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ee2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.142101:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ee2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.142204:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11263:x1875544000999680:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 396us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658470.142221:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:2.0:1788658470.146846:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658470.147036:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.147180:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001000064 00000100:00100000:1.0:1788658470.147194:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001000064 00000100:00100000:1.0:1788658470.147283:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:1.0:1788658470.147298:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11263:x1875544001000064:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658470.147617:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:11263:x1875544001000064:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 322us (579us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788658470.147645:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:0.0:1788658470.150063:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544000999808 00000100:00100000:0.0:1788658470.150084:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544000999808 00000100:00100000:1.0:1788658470.150615:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:1.0:1788658470.150631:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:2396:x1875544000999808:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658470.150652:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658470.150685:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6ee1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7bf expref: 23 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.150737:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:1.0:1788658470.150745:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658470.150840:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:2396:x1875544000999808:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 213us (4008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.150848:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00010000:00010000:2.0:1788658470.338222:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658470.427974:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.428203:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001000320 00000100:00100000:1.0:1788658470.428217:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001000320 00000100:00100000:1.0:1788658470.428351:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 74 00000100:00100000:1.0:1788658470.428363:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11281:x1875544001000320:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:1.0:1788658470.428396:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658470.428422:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ee34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7c6 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.428560:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ee3b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.428580:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ee3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.428594:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ee3b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658470.428626:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788658470.429119:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ee34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7c6 expref: 25 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.429143:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ee3b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7c6 expref: 24 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.429154:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:1.0:1788658470.429158:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788658470.429163:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418600, rc 0) 00000100:00100000:1.0:1788658470.429606:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:11281:x1875544001000320:12345-192.168.202.53@tcp:101:cat.0 Request processed in 1242us (1643us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1788658470.429616:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 74 00000100:00100000:2.0:1788658470.459648:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658470.459755:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001000448 00000100:00100000:3.0:1788658470.459779:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001000448 00000100:00100000:3.0:1788658470.459875:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 75 00000100:00100000:3.0:1788658470.459888:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:11282:x1875544001000448:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658470.459929:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658470.459963:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7cd expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.460066:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ee50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.460083:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ee50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.460099:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ee50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658470.460270:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788658470.460275:0:7958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658470.460363:0:7958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ee50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.460396:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7cd expref: 26 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.460443:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ee50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7cd expref: 25 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.460452:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658470.460455:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658470.460459:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031200, rc 0) 00000100:00100000:3.0:1788658470.460558:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11282:x1875544001000448:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 672us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658470.460566:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 75 00000100:00100000:2.0:1788658470.464883:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.465060:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001000832 00000100:00100000:1.0:1788658470.465074:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001000832 00000100:00100000:1.0:1788658470.465196:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:1.0:1788658470.465211:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11282:x1875544001000832:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658470.465609:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:11282:x1875544001000832:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 400us (776us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788658470.465620:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1788658470.471769:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658470.472518:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001000960 00000100:00100000:2.0:1788658470.472533:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001000960 00000100:00100000:2.0:1788658470.473000:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1788658470.473017:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:11282:x1875544001000960:12345-192.168.202.53@tcp:103:lfs.0 00010000:00010000:2.0:1788658470.473041:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788658470.473077:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6ede0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7b1 expref: 26 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.473119:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6ee3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7c6 expref: 25 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.473143:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ecd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc76b expref: 24 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.473156:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:2.0:1788658470.473164:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658470.473242:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:11282:x1875544001000960:12345-192.168.202.53@tcp:103:lfs.0 Request processed in 230us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658470.473251:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1788658470.477459:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658470.478698:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001001088 00000100:00100000:3.0:1788658470.478915:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001001088 00000100:00100000:3.0:1788658470.479047:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:3.0:1788658470.479062:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:11282:x1875544001001088:12345-192.168.202.53@tcp:58:lfs.0 00010000:00010000:3.0:1788658470.479254:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee57 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.479276:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.479292:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658470.479606:0:6536:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658470.479977:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788658470.480069:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788658470.480243:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:11282:x1875544001001088:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 1179us (2800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658470.480267:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:1.0:1788658470.510626:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.510905:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001001216 00000100:00100000:0.0:1788658470.510920:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001001216 00000100:00100000:0.0:1788658470.511010:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:0.0:1788658470.511022:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:11284:x1875544001001216:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658470.511051:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658470.511081:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7d4 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511216:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511235:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511263:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511283:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511291:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511298:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511480:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511490:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511567:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658470.511823:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788658470.511829:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658470.511865:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511882:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511892:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511911:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511923:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511929:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658470.511934:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511943:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511958:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658470.511961:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658470.511966:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511972:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511989:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.511995:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.512000:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.512005:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658470.512013:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.512020:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.512028:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e70100) 00010000:00010000:0.0:1788658470.512031:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658470.512034:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.512039:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.512080:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7d4 expref: 25 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.512095:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7d4 expref: 24 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.512104:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658470.512106:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658470.512109:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391a00, rc 0) 00000100:00100000:0.0:1788658470.512187:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:11284:x1875544001001216:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1165us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.512195:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 77 00000040:00080000:3.0:1788658470.591173:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788658470.591189:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788658470.591230:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788658470.591242:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788658470.591448:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e5b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025205504:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788658470.591608:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658470.599947:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.599993:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001001344 00000100:00100000:1.0:1788658470.600005:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001001344 00000100:00100000:1.0:1788658470.600071:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:1.0:1788658470.600083:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11295:x1875544001001344:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1788658470.600257:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e5b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025205504:192.168.202.53@tcp:107:hsm_cdtr.0 00000004:00000080:1.0:1788658470.600573:0:6537:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788658470.600953:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:11295:x1875544001001344:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 870us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.600964:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:3.0:1788658470.603418:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.605974:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001001472 00000100:00100000:0.0:1788658470.605997:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001001472 00000100:00100000:0.0:1788658470.606287:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:0.0:1788658470.606302:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:11295:x1875544001001472:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788658470.606417:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee7a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.606441:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee7a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.606458:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee7a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610321:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee81 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610347:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610360:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610399:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610409:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610414:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658470.610470:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788658470.610474:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658470.610488:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610501:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee7a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610525:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee7a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610532:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee7a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610538:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658470.610542:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee7a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610549:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee7a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610563:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:0.0:1788658470.610566:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658470.610571:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee7a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.610577:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ee7a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612149:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee81 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612165:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee81 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612173:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee81 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612178:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658470.612198:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee81 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612206:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee81 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612220:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8a1e90e70100) 00010000:00010000:0.0:1788658470.612223:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658470.612227:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee81 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612234:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ee81 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612254:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612260:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612266:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612271:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658470.612274:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612279:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612286:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:0.0:1788658470.612288:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658470.612299:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.612304:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ee88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658470.612411:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:11295:x1875544001001472:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 6108us (9003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.612421:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:3.0:1788658470.616660:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.616810:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001001728 00000100:00100000:1.0:1788658470.616825:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001001728 00000100:00100000:1.0:1788658470.616916:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:1.0:1788658470.616928:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:11295:x1875544001001728:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658470.616954:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658470.616992:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6ee8f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7db expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617127:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ee96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617146:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ee96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617161:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ee96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658470.617185:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788658470.617530:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ee96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617540:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ee96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617547:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ee96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617560:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658470.617566:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ee96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617575:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ee96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617589:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:1.0:1788658470.617593:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658470.617598:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ee96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617605:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6ee96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617654:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6ee8f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7db expref: 26 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617666:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:1.0:1788658470.617668:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658470.617673:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418e00/0x48e67cc629c6ee8f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7db expref: 26 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.617683:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418e00, rc 0) 00000100:00100000:1.0:1788658470.617890:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11295:x1875544001001728:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 962us (1239us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788658470.617899:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:1.0:1788658470.622112:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.622290:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001001856 00000100:00100000:0.0:1788658470.622304:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001001856 00000100:00100000:0.0:1788658470.622384:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:0.0:1788658470.622396:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11295:x1875544001001856:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788658470.622446:0:11974:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788658470.622600:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11295:x1875544001001856:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 205us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.622608:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:3.0:1788658470.626397:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.626802:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001002112 00000100:00100000:0.0:1788658470.626816:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001002112 00000100:00100000:0.0:1788658470.626899:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 82 00000100:00100000:0.0:1788658470.626912:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11295:x1875544001002112:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658470.626940:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658470.626944:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788658470.626977:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ee50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7cd expref: 25 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.627004:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658470.627010:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658470.627049:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6eea4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7e2 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658470.627580:0:6536:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788658470.627804:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6eeab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.627821:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6eeab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.627847:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6eeab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.627909:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6eea4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e2 expref: 27 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.627925:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6eeab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e2 expref: 26 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.627934:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70100) 00010000:00010000:0.0:1788658470.627937:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658470.627940:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390400, rc 0) 00000100:00100000:0.0:1788658470.628012:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:11295:x1875544001002112:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 1104us (1627us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788658470.628020:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 82 00000100:00100000:3.0:1788658470.632069:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.632159:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001002368 00000100:00100000:1.0:1788658470.632177:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001002368 00000100:00100000:0.0:1788658470.632263:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00100000:0.0:1788658470.632278:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:11295:x1875544001002368:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788658470.632360:0:11974:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658470.632402:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6eeab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e2 expref: 26 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632422:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70100) 00010000:00010000:0.0:1788658470.632435:0:11974:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658470.632463:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eeb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632481:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eeb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632491:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eeb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632506:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6eec0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb9260d3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632513:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6eec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb9260d3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632534:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6eec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb9260d3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632592:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eeb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632598:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eeb9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632603:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eeb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632607:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658470.632617:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eeb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632624:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eeb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632631:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658470.632633:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658470.632636:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eeb9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632641:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6eeb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632648:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6eec0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb9260d3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632651:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6eec0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb9260d3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632655:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6eec0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb9260d3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632658:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658470.632660:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6eec0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb9260d3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632663:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6eec0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb9260d3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632667:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb9260d3a (ffff8a1e90e70c00) 00010000:00010000:0.0:1788658470.632668:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658470.632674:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6eec0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb9260d3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.632678:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6eec0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb9260d3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658470.632805:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11295:x1875544001002368:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 531us (747us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788658470.632813:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00100000:1.0:1788658470.635762:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.635927:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001002496 00000100:00100000:0.0:1788658470.635942:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001002496 00000100:00100000:0.0:1788658470.636013:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 84 00000100:00100000:0.0:1788658470.636027:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11295:x1875544001002496:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658470.636052:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658470.636081:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6eec7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7e9 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.636128:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.636145:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.636160:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.636298:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6eec7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e9 expref: 27 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.636321:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e9 expref: 26 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.636337:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:0.0:1788658470.636341:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658470.636345:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d0400, rc 0) 00000100:00100000:0.0:1788658470.636757:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:11295:x1875544001002496:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 730us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.636766:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 84 00000100:00100000:1.0:1788658470.640807:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.641355:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001002752 00000100:00100000:0.0:1788658470.641369:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001002752 00000100:00100000:0.0:1788658470.641449:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:0.0:1788658470.641461:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:11295:x1875544001002752:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788658470.641586:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.641608:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.641623:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658470.642015:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788658470.642024:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387858320668ns, next at 388858318648ns, rc = 0 00000004:00010000:0.0:1788658470.642085:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab092a91 reply state 00000000e87ee2ce transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.642098:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.642105:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:0.0:1788658470.642120:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788658470.642126:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658470.642275:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:11295:x1875544001002752:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 814us (1480us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788658470.642284:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:2.0:1788658470.644145:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.644196:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001002880 00000100:00100000:0.0:1788658470.644209:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001002880 00000100:00100000:0.0:1788658470.644466:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:0.0:1788658470.644480:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:11295:x1875544001002880:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658470.644510:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658470.644536:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eedc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7f0 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.644667:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eedc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f0 expref: 29 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.644686:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eedc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f0 expref: 29 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.644838:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:0.0:1788658470.644843:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658470.644848:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec21d1200, rc 0) 00000100:00100000:0.0:1788658470.645061:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:11295:x1875544001002880:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 583us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.645069:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:1.0:1788658470.648419:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.648648:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001003008 00000100:00100000:0.0:1788658470.648663:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001003008 00000100:00100000:0.0:1788658470.648782:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:0.0:1788658470.648802:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875544001003008:12345-192.168.202.53@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788658470.648861:0:8452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp t0 exp 0000000000000000 cur 387 last 0 00000020:00000080:0.0:1788658470.648903:0:8452:0:(genops.c:1385:class_connect()) connect: client 8cbe5c26-08aa-4214-8c09-2005fb4b10e9, cookie 0x48e67cc629c6eee3 00002000:00100000:0.0:1788658470.648919:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8cbe5c26-08aa-4214-8c09-2005fb4b10e9/ffff8a1e98865000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658470.648944:0:8452:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658470.649047:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788658470.649087:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8a1e98865800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658470.649177:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2395:x1875544001003008:12345-192.168.202.53@tcp:8:lhsmtool_posix.0 Request processed in 376us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.649186:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:1.0:1788658470.650924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658470.651170:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001003136 00000100:00100000:2.0:1788658470.651182:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001003136 00000100:00080000:1.0:1788658470.651406:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658470.651562:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:2.0:1788658470.651572:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:0:x1875544001003136:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000001:00080000:1.0:1788658470.663070:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:1.0:1788658470.663087:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000100:00100000:2.0:1788658470.663327:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:0:x1875544001003136:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 11742us (12400us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788658470.663341:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:1.0:1788658470.667444:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658470.667494:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001003392 00000100:00100000:3.0:1788658470.667508:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001003392 00000100:00100000:3.0:1788658470.667591:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:3.0:1788658470.667606:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:11295:x1875544001003392:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788658470.667920:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11295:x1875544001003392:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 318us (488us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788658470.667930:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:1.0:1788658470.669783:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.669854:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001003648 00000100:00100000:0.0:1788658470.669867:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001003648 00000100:00100000:0.0:1788658470.669930:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 87 00000100:00100000:0.0:1788658470.669944:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11295:x1875544001003648:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788658470.670066:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11295:x1875544001003648:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 125us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.670075:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 87 00000100:00100000:2.0:1788658470.679367:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658470.679873:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001003776 00000100:00100000:3.0:1788658470.679887:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001003776 00000100:00100000:3.0:1788658470.679967:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 88 00000100:00100000:3.0:1788658470.680100:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11295:x1875544001003776:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658470.680128:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658470.680156:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6eeea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7f7 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.680260:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eef1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.680277:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.680292:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658470.680352:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658470.680377:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eef1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.680408:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6eeea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f7 expref: 32 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.680433:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eef1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f7 expref: 31 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.680443:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:3.0:1788658470.680446:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788658470.680451:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031600, rc 0) 00000100:00100000:3.0:1788658470.680528:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:11295:x1875544001003776:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 433us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658470.680765:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 88 00000100:00100000:2.0:1788658470.684819:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658470.684936:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001003904 00000100:00100000:3.0:1788658470.684947:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001003904 00000100:00100000:3.0:1788658470.685055:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:3.0:1788658470.685078:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544001003904:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658470.685101:0:10365:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658470.685127:0:10365:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a45e88e/0x48e67cc629c6eef8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc7fe expref: -99 pid: 10365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658470.685159:0:10365:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc326, blocks: 0x0 00010000:00010000:3.0:1788658470.685184:0:10365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1788658470.685189:0:10365:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658470.685201:0:10365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a45e88e/0x48e67cc629c6eef8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7fe expref: 6 pid: 10365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.685226:0:10365:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a45e88e/0x48e67cc629c6eef8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7fe expref: 6 pid: 10365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.685242:0:10365:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031800, rc 0) 00000100:00100000:3.0:1788658470.685313:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544001003904:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 238us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658470.685321:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:1.0:1788658470.688760:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.688855:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001004160 00000100:00100000:0.0:1788658470.688868:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001004160 00000100:00100000:0.0:1788658470.688936:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:0.0:1788658470.688946:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:11295:x1875544001004160:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788658470.689180:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:11295:x1875544001004160:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 234us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.689186:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:2.0:1788658470.699020:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.699175:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001004288 00000100:00100000:1.0:1788658470.699188:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001004288 00000100:00100000:1.0:1788658470.699254:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:1.0:1788658470.699267:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:11295:x1875544001004288:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658470.699290:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658470.699318:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc805 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.699359:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a45e88e/0x48e67cc629c6eef8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7fe expref: 7 pid: 10365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.699370:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658470.699375:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658470.699381:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.699445:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a45e88e/0x48e67cc629c6eef8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7fe expref: 7 pid: 10365 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.699473:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a45e88e/0x48e67cc629c6eef8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7fe expref: 7 pid: 10365 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658470.699489:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1875544025205632:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658470.699915:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658470.702503:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658470.702740:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001004416 00000100:00100000:3.0:1788658470.702751:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001004416 00010000:00010000:3.0:1788658470.702796:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a45e88e/0x48e67cc629c6eef8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7fe expref: 8 pid: 10365 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658470.702849:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:3.0:1788658470.702862:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001004416:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658470.702901:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658470.702924:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a45e88e/0x48e67cc629c6eef8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7fe expref: 8 pid: 10365 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.702936:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a45e88e/0x48e67cc629c6eef8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7fe expref: 8 pid: 10365 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.702972:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658470.702976:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658470.702993:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.703004:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.703051:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658470.703066:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6523:1875544025205760:192.168.202.53@tcp:105: 00000100:00100000:3.0:1788658470.703303:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d240 going to sleep for 11 seconds 00010000:00010000:1.0:1788658470.703874:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a45e88e/0x48e67cc629c6eef8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7fe expref: 8 pid: 10365 timeout: 487 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658470.703897:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1875544025205632:192.168.202.53@tcp:104: 00010000:00010000:1.0:1788658470.703926:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.703936:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419600, rc 0) 00000100:00100000:1.0:1788658470.704104:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:11295:x1875544001004288:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 4840us (5099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.704111:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:3.0:1788658470.708073:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e58380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6523:1875544025205760:192.168.202.53@tcp:105: 00010000:00010000:3.0:1788658470.708166:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658470.708253:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544001004416:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 5392us (5759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658470.708266:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:1.0:1788658470.711848:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.711914:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001004544 00000100:00100000:0.0:1788658470.711926:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001004544 00002000:00100000:0.0:1788658470.712086:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8a1d83d50380 x1875544001004544/t0(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:61/0 lens 504/0 e 0 to 0 dl 1788658481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658470.712097:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d83d50380 with x1875544001004544 ext(0->8) 00002000:00010000:0.0:1788658470.712102:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1d83d50380 00000100:00100000:0.0:1788658470.712175:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1788658470.712184:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544001004544:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788658470.716134:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2397:x1875544001004544:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 Request processed in 3940us (4302us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788658470.716153:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00002000:00100000:0.0:1788658470.716167:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8a1d83d50380 x1875544001004544/t4294967303(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:61/0 lens 504/448 e 0 to 0 dl 1788658481 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658470.716193:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d83d50380 with x1875544001004544 ext(0->8) 00002000:00010000:0.0:1788658470.716200:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1d83d50380 00000100:00100000:0.0:1788658470.718211:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.718403:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001004672 00000100:00100000:1.0:1788658470.718419:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001004672 00000100:00100000:1.0:1788658470.718489:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:1.0:1788658470.718499:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:11295:x1875544001004672:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788658470.723486:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1788658470.723511:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:2.0:1788658470.723686:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658470.723956:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025205888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788658470.724055:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658470.724175:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724184:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724189:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658470.724193:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724200:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724217:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:2.0:1788658470.724237:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658470.724243:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724248:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6edd2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724279:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724285:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724290:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724295:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658470.724298:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724304:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724313:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:2.0:1788658470.724316:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788658470.724319:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.724326:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1a00/0x48e67cc629c6eed5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.724356:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025205888 00000100:00100000:2.0:1788658470.724365:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025205888 00000100:00100000:2.0:1788658470.724444:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658470.724455:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025205888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788658470.724618:0:13833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788658470.724622:0:13833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788658470 00002000:00010000:2.0:1788658470.724624:0:13833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788658470.724627:0:13833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788658470 -> 1788658470 00002000:00010000:2.0:1788658470.724630:0:13833:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00080000:1.0:1788658470.725005:0:6515:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00080000:1.0:1788658470.725033:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1788658470.725043:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788658470.725054:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788658470.725598:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:11295:x1875544001004672:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 7093us (7388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.725609:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:2.0:1788658470.728320:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025205888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3851us (4248us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788658470.728339:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788658470.729273:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1e84e58380/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788658470.729287:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025205888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788658470.729794:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658470.729882:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001004800 00000100:00100000:3.0:1788658470.729893:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001004800 00000100:00100000:3.0:1788658470.729938:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:3.0:1788658470.729946:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2399:x1875544001004800:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788658470.731592:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788658470.731613:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1788658470.731864:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544001004800:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 1909us (2066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658470.731878:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:3.0:1788658470.735989:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.736148:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001005056 00000100:00100000:0.0:1788658470.736159:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001005056 00000100:00100000:0.0:1788658470.736254:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 91 00000100:00100000:0.0:1788658470.736264:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:11295:x1875544001005056:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788658470.736367:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658470.736403:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6eef1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f7 expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.736432:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:0.0:1788658470.736437:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658470.736478:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.736496:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.736508:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788658470.736945:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad7f1331 reply state 00000000dd0e77b3 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.736959:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.736971:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:1.0:1788658470.736973:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788658470.736975:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788658470.737104:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:11295:x1875544001005056:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 842us (1129us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788658470.737110:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 91 00000100:00100000:2.0:1788658470.739078:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.739199:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001005184 00000100:00100000:1.0:1788658470.739213:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001005184 00000100:00100000:1.0:1788658470.739306:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:1.0:1788658470.739319:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544001005184:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788658470.739558:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788658470.739562:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788658470 -> 1788658469 00002000:00010000:1.0:1788658470.739564:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788658467 00002000:00010000:1.0:1788658470.739566:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788658470 -> 1788658469 00002000:00010000:1.0:1788658470.739567:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788658470.739648:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001005184:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 332us (581us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788658470.739654:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:2.0:1788658470.748297:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.748387:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001005440 00000100:00100000:1.0:1788658470.748402:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001005440 00000100:00100000:1.0:1788658470.748490:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 92 00000100:00100000:1.0:1788658470.748511:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:11295:x1875544001005440:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788658470.748623:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.748644:0:11974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e9 expref: 15 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.748657:0:11974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.748751:0:11974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e9 expref: 15 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.748768:0:11974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e9 expref: 15 pid: 6538 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658470.748837:0:11974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025206016:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658470.748960:0:11974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658470.754138:0:11974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025206016:192.168.202.53@tcp:104: 00010000:00010000:1.0:1788658470.754182:0:11974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.755583:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.755831:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001005568 00000100:00100000:0.0:1788658470.755843:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001005568 00010000:00010000:0.0:1788658470.755897:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e9 expref: 16 pid: 6538 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658470.755948:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:0.0:1788658470.755960:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:2397:x1875544001005568:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658470.755978:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658470.755987:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e9 expref: 16 pid: 6538 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.756002:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e9 expref: 16 pid: 6538 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.756043:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d0400/0x48e67cc629c6eece lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7e9 expref: 16 pid: 6538 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.756060:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:0.0:1788658470.756066:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.756078:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.756087:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.762965:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658470.763082:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:2397:x1875544001005568:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 7113us (7497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.763097:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00010000:00010000:2.0:1788658470.765247:0:11974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.765272:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.765330:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.765338:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.765345:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.765352:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658470.765357:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.765382:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.765406:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:2.0:1788658470.765409:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788658470.765416:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.765423:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6ef0d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.765555:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:11295:x1875544001005440:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 Request processed in 17039us (17265us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788658470.765566:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 92 00000100:00100000:2.0:1788658470.774555:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.775354:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001005696 00000100:00100000:0.0:1788658470.775371:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001005696 00000100:00100000:1.0:1788658470.775531:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:1.0:1788658470.775545:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2399:x1875544001005696:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788658470.775607:0:13833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.775633:0:13833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.775644:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658470.775648:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658470.775654:0:13833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.775722:0:13833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.775749:0:13833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 7 pid: 8453 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658470.775779:0:13833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13833:1875544025206144:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658470.775893:0:13833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658470.779321:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658470.780034:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001005824 00000100:00100000:2.0:1788658470.780048:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001005824 00010000:00010000:2.0:1788658470.780102:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 8 pid: 8453 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.780155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:2.0:1788658470.780168:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001005824:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658470.780188:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658470.780216:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 8 pid: 8453 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.780231:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 8 pid: 8453 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.780275:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658470.780280:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658470.780288:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.780300:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.780326:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658470.780401:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001005824:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 236us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658470.780409:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00010000:00010000:1.0:1788658470.783627:0:13833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094ac851b/0x48e67cc629c6eeff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc805 expref: 7 pid: 8453 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658470.783656:0:13833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13833:1875544025206144:192.168.202.53@tcp:104: 00010000:00010000:1.0:1788658470.783689:0:13833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.783717:0:13833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.783726:0:13833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.783775:0:13833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.783784:0:13833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.783808:0:13833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.783826:0:13833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658470.783832:0:13833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.783842:0:13833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.783869:0:13833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.783878:0:13833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c79a0d3/0x48e67cc629c6ef14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658470.783997:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544001005696:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 8453us (9454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.784008:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:0.0:1788658470.788661:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.788779:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001006080 00000100:00100000:1.0:1788658470.788792:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001006080 00000100:00100000:1.0:1788658470.788876:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 93 00000100:00100000:1.0:1788658470.788890:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:11295:x1875544001006080:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788658470.789002:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.789036:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc78e expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.789046:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.789096:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc78e expref: 14 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.789114:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc78e expref: 14 pid: 6536 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658470.789132:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875544025206272:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658470.789230:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658470.796581:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875544025206272:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658470.796597:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00010000:00010000:3.0:1788658470.796628:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.796647:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001006208 00000100:00100000:2.0:1788658470.796656:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001006208 00010000:00010000:2.0:1788658470.796735:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc78e expref: 15 pid: 6536 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.796789:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:2.0:1788658470.796801:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ea0fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:2396:x1875544001006208:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658470.796829:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658470.796838:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc78e expref: 15 pid: 6536 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.796854:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc78e expref: 15 pid: 6536 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.796895:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6ed5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc78e expref: 15 pid: 6536 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.796915:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:2.0:1788658470.796920:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.796932:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.796942:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.796973:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658470.796991:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.797002:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.797042:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ea0fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:2396:x1875544001006208:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 242us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658470.797051:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 62 00010000:00010000:3.0:1788658470.797233:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.797249:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eedc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f0 expref: 14 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.797260:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.797294:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eedc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f0 expref: 14 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.797322:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eedc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f0 expref: 14 pid: 11974 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658470.797339:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875544025206400:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658470.797411:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658470.805551:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875544025206400:192.168.202.53@tcp:104: 00010000:00010000:1.0:1788658470.805591:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.805738:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658470.806008:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001006336 00000100:00100000:0.0:1788658470.806018:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001006336 00010000:00010000:0.0:1788658470.806077:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eedc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f0 expref: 15 pid: 11974 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658470.806286:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:0.0:1788658470.806297:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:2397:x1875544001006336:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658470.806314:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658470.806323:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eedc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f0 expref: 15 pid: 11974 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.806349:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eedc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f0 expref: 15 pid: 11974 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.806376:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ec21d1200/0x48e67cc629c6eedc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7f0 expref: 15 pid: 11974 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.806392:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:0.0:1788658470.806397:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.806408:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.806416:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658470.806449:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658470.806510:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:2397:x1875544001006336:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 214us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.806518:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00010000:00010000:1.0:1788658470.806731:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.806741:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658470.806912:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1788658470.807063:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788658470.807106:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788658470.807212:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6538:1875544025206528:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788658470.807381:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658470.807428:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788658470.807475:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025206528 00000100:00100000:3.0:1788658470.807484:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025206528 00000100:00100000:3.0:1788658470.807536:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788658470.807547:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6538:x1875544025206528:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788658470.812284:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6538:x1875544025206528:12345-0@lo:1000:mdt00_002.0 Request processed in 4724us (4890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658470.812302:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788658470.812374:0:6538:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788658470.812382:0:6538:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1e84e58380, transno 4294967304 00000100:00100000:2.0:1788658470.812409:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6538:1875544025206528:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788658470.812621:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788658470.812746:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e25180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6538:1875544025206656:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788658470.813033:0:6538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658470.813072:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead8f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658470.813154:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025206656 00000100:00100000:1.0:1788658470.813162:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025206656 00000100:00100000:1.0:1788658470.813209:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788658470.813218:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6538:x1875544025206656:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788658470.813326:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6538:x1875544025206656:12345-0@lo:1000:mdt00_002.0 Request processed in 110us (295us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788658470.813331:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788658470.813748:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e25180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6538:1875544025206656:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788658470.813898:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.813916:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.813924:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.813932:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658470.813937:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.813946:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.813976:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:2.0:1788658470.813980:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658470.813986:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.813992:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6ef22 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814023:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee57 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814029:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee57 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814035:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee57 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814040:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658470.814050:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee57 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814056:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee57 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814065:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:2.0:1788658470.814067:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658470.814071:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee57 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814077:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6ee57 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814107:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814125:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7d4 expref: 17 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814135:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814172:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7d4 expref: 17 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658470.814191:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7d4 expref: 17 pid: 6538 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.814206:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e27100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875544025206784:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658470.814303:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead8f5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658470.818283:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e27100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875544025206784:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658470.818322:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658470.820693:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658470.821315:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001006464 00000100:00100000:3.0:1788658470.821329:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001006464 00010000:00010000:3.0:1788658470.821387:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7d4 expref: 18 pid: 6538 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658470.821440:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:3.0:1788658470.821453:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:2397:x1875544001006464:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658470.821473:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658470.821482:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7d4 expref: 18 pid: 6538 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.821510:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7d4 expref: 18 pid: 6538 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.821540:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6ee73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc7d4 expref: 18 pid: 6538 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.821572:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:3.0:1788658470.821580:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.821591:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.821600:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.821642:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658470.821748:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:2397:x1875544001006464:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 297us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658470.821756:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 64 00010000:00010000:1.0:1788658470.822024:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822034:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822050:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822057:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822065:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822072:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658470.822077:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822086:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822112:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:1.0:1788658470.822115:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658470.822119:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822125:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6ef29 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822136:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822142:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822147:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822151:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658470.822154:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822160:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822167:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e70600) 00010000:00010000:1.0:1788658470.822169:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788658470.822172:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.822178:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6ef1b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658470.822379:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:11295:x1875544001006080:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 33491us (33731us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788658470.822389:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 93 00000020:00080000:1.0:1788658470.822394:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788658470.823858:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788658470.823869:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788658470.823894:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788658470.823901:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788658470.827348:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658470.828172:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001006720 00000100:00100000:1.0:1788658470.828189:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001006720 00000100:00100000:1.0:1788658470.828275:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:1.0:1788658470.828290:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:11295:x1875544001006720:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788658470.828637:0:13563:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788658470.828680:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1788658470.828985:0:13563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.829006:0:13563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.829021:0:13563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.829032:0:13563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.829039:0:13563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.829046:0:13563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658470.829111:0:13563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788658470.829239:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:11295:x1875544001006720:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 952us (1904us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788658470.829249:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000020:00080000:1.0:1788658470.829254:0:13563:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788658470.830617:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658470.830633:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.830642:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658470.830659:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.830670:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.830690:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:3.0:1788658470.830693:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788658470.830699:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.830888:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6ef30 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658470.830902:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658470.830905:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658470.830907:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658470.850398:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025207040:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.850476:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.850575:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025207552:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.850612:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.850734:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025208064:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.850773:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.850839:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788658470.850847:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025206912:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.850877:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.850898:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025207424:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.850922:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.850942:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025207936:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.850964:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.850989:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025207168:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.851026:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.851045:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025207680:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.851067:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.851083:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025208192:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.851103:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.851121:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788658470.851126:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025207296:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.851150:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.851160:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025207808:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.851180:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.851198:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025208320:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.851220:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.851251:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025207424 00000100:00100000:0.0:1788658470.851259:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025207424 00000100:00100000:0.0:1788658470.851297:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025207168 00000100:00100000:0.0:1788658470.851301:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025207168 00000100:00100000:0.0:1788658470.851314:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788658470.851322:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025207424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.851396:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025207424:12345-0@lo:400:kworker.0 Request processed in 71us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.851403:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788658470.851427:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788658470.851436:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025207168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658470.851481:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025207040 00000100:00100000:0.0:1788658470.851482:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025207168:12345-0@lo:400:kworker.0 Request processed in 47us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.851494:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788658470.851495:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025207040 00000100:00100000:0.0:1788658470.851526:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025207936 00000100:00100000:0.0:1788658470.851533:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025207936 00000100:00100000:1.0:1788658470.851576:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025207552 00000100:00100000:0.0:1788658470.851581:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025207808 00000100:00100000:1.0:1788658470.851583:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025207552 00000100:00100000:0.0:1788658470.851589:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025207808 00000100:00100000:1.0:1788658470.851633:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025208064 00000100:00100000:1.0:1788658470.851638:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025208064 00000100:00100000:0.0:1788658470.851642:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025208320 00000100:00100000:0.0:1788658470.851648:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025208320 00000100:00100000:1.0:1788658470.851665:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025207680 00000100:00100000:1.0:1788658470.851670:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025207680 00000100:00100000:0.0:1788658470.851684:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788658470.851695:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1875544025207936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658470.851698:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025208192 00000100:00100000:1.0:1788658470.851737:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025208192 00000100:00100000:1.0:1788658470.851766:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025207296 00000100:00100000:1.0:1788658470.851770:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025207296 00000100:00100000:0.0:1788658470.851785:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1875544025207936:12345-0@lo:400:kworker.0 Request processed in 92us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.851794:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788658470.851801:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788658470.851819:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025207040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658470.851896:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025207040:12345-0@lo:400:kworker.0 Request processed in 91us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.851903:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788658470.851920:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788658470.851925:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025207552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658470.851952:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025207552:12345-0@lo:400:kworker.0 Request processed in 27us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.851958:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788658470.851967:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788658470.851973:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025208064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658470.852018:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025208064:12345-0@lo:400:kworker.0 Request processed in 46us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.852029:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788658470.852039:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788658470.852044:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025207680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658470.852070:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025207680:12345-0@lo:400:kworker.0 Request processed in 27us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.852076:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788658470.852198:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788658470.852205:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025208192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658470.852234:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025208192:12345-0@lo:400:kworker.0 Request processed in 30us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.852240:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788658470.852251:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788658470.852257:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025207296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658470.852282:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025207296:12345-0@lo:400:kworker.0 Request processed in 26us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.852288:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788658470.852315:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025206912 00000100:00100000:1.0:1788658470.852318:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025206912 00000100:00100000:1.0:1788658470.852348:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788658470.852353:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025206912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658470.852382:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025206912:12345-0@lo:400:kworker.0 Request processed in 29us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.852388:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788658470.856329:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788658470.856356:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788658470.856370:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025207808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.856399:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025208320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658470.856523:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025207808:12345-0@lo:400:kworker.0 Request processed in 176us (5339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658470.856533:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788658470.856565:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025208320:12345-0@lo:400:kworker.0 Request processed in 183us (5341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658470.856576:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788658470.856615:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658470.856625:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658470.856629:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788658470.856635:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658470.856668:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025208448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658470.856673:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025207296:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.856732:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025207808:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.856757:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025208320:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.856770:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025207168:0@lo:400:kworker.0 00010000:00080000:0.0:1788658470.856785:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d54a80 x1875544025207680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658470.856797:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025207680:0@lo:400:kworker.0 00010000:00080000:0.0:1788658470.856823:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d54700 x1875544025208192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658470.856833:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025208192:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.856893:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025208576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658470.856931:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658470.856989:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025206912:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.857003:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025207424:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.857015:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025207936:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.857026:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025207040:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.857036:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025207552:0@lo:400:kworker.0 00000100:00100000:0.0:1788658470.857047:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025208064:0@lo:400:kworker.0 00000100:00100000:3.0:1788658470.857177:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025208576 00000100:00100000:3.0:1788658470.857187:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025208576 00000100:00100000:3.0:1788658470.857244:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788658470.857254:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025208576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788658470.857276:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788658470.857324:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025208576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658470.857332:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788658470.857604:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658470.857861:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025208448 00000100:00100000:3.0:1788658470.857867:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025208448 00000100:00100000:3.0:1788658470.857896:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788658470.857903:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025208448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788658470.857916:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788658470.857959:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025208448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658470.857967:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788658470.858167:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025208448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658470.858223:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025208576:0@lo:13:osp-pre-1-1.0 00000040:00080000:1.0:1788658471.058567:0:14225:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658471.058581:0:14225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658471.058613:0:14225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788658471.058624:0:14225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788658471.134562:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.134663:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001006976 00000100:00100000:3.0:1788658471.134673:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001006976 00000100:00100000:3.0:1788658471.134779:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 94 00000100:00100000:3.0:1788658471.134791:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:11305:x1875544001006976:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658471.134814:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658471.134834:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc80c expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.134950:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ef3e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.134966:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ef3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.134989:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ef3e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658471.135001:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788658471.135109:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc80c expref: 21 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.135130:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ef3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc80c expref: 20 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.135139:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658471.135142:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788658471.135158:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031e00, rc 0) 00000100:00100000:3.0:1788658471.135209:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:11305:x1875544001006976:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 420us (657us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788658471.135675:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 94 00000100:00080000:0.0:1788658471.136601:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658471.137911:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658471.138020:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001007104 00000100:00100000:2.0:1788658471.138031:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001007104 00000100:00100000:2.0:1788658471.138085:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 95 00000100:00100000:2.0:1788658471.138095:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:11305:x1875544001007104:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:2.0:1788658471.138163:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6ef4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138177:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6ef4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138189:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6ef4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138204:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ef53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138212:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ef53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138230:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ef53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138305:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138313:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138319:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658471.138367:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138380:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6ef4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138386:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6ef4c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138392:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6ef4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138397:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658471.138402:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6ef4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138409:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6ef4c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138421:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:2.0:1788658471.138424:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658471.138428:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6ef4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138435:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6ef4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138445:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ef53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138451:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ef53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138461:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ef53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138466:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658471.138468:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ef53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138474:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ef53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138482:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1d83406700) 00010000:00010000:2.0:1788658471.138484:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658471.138487:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ef53 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138492:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6ef53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138507:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138513:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138518:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138523:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658471.138525:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138540:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138549:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1d83406f00) 00010000:00010000:2.0:1788658471.138552:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658471.138555:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.138560:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6ef5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658471.138629:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:11305:x1875544001007104:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 534us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658471.138637:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 95 00000100:00100000:3.0:1788658471.162944:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.163083:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001007360 00000100:00100000:0.0:1788658471.163096:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001007360 00000100:00100000:0.0:1788658471.163194:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 96 00000100:00100000:0.0:1788658471.163206:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:11308:x1875544001007360:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658471.163235:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658471.163264:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ef61 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc813 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.163359:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ef68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.163551:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ef68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.163569:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ef68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.163590:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ef6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.163598:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ef6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.163605:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ef6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164092:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164104:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164113:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658471.164126:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788658471.164230:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ef68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164238:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ef68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164245:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ef68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164252:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658471.164257:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ef68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164267:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ef68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164293:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658471.164295:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658471.164299:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ef68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164304:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6ef68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164317:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ef6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164321:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ef6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164325:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ef6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164328:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658471.164329:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ef6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164332:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ef6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164336:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e70c00) 00010000:00010000:3.0:1788658471.164337:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658471.164339:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ef6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164342:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6ef6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164394:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6ef61 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc813 expref: 23 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164411:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc813 expref: 22 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.164418:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658471.164421:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658471.164423:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031400, rc 0) 00000100:00100000:3.0:1788658471.164507:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11308:x1875544001007360:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1302us (1576us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788658471.164516:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 96 00000100:00100000:0.0:1788658471.169745:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.169927:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001007488 00000100:00100000:3.0:1788658471.169939:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001007488 00000100:00100000:3.0:1788658471.169999:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:3.0:1788658471.170009:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11308:x1875544001007488:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:3.0:1788658471.170144:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.170162:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.170175:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.170217:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.170245:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.170252:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.170257:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658471.170261:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.170269:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.170281:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658471.170284:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658471.170289:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.170296:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658471.170435:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11308:x1875544001007488:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 426us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658471.170442:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:1.0:1788658471.177220:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658471.177333:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001007744 00000100:00100000:2.0:1788658471.177344:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001007744 00000100:00100000:2.0:1788658471.177420:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1788658471.177433:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11308:x1875544001007744:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1788658471.177659:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:11308:x1875544001007744:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 228us (450us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788658471.177667:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:0.0:1788658471.236571:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.236665:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001008000 00000100:00100000:3.0:1788658471.236675:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001008000 00000100:00100000:3.0:1788658471.236754:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:3.0:1788658471.236774:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:10832:x1875544001008000:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1788658471.236797:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658471.236829:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ef8b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc81a expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.236934:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.236949:0:7958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc813 expref: 24 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.236959:0:7958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.236989:0:7958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc813 expref: 24 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.237002:0:7958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc813 expref: 24 pid: 6538 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658471.237015:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e59500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025208704:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658471.237096:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788658471.241755:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658471.241846:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001008128 00000100:00100000:1.0:1788658471.241856:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001008128 00010000:00010000:1.0:1788658471.241896:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc813 expref: 25 pid: 6538 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658471.241926:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e59500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025208704:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658471.241942:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00010000:00010000:0.0:1788658471.241950:0:7958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658471.241951:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:2397:x1875544001008128:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658471.241965:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658471.241971:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc813 expref: 25 pid: 6538 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.241984:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc813 expref: 25 pid: 6538 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.242013:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6ef76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc813 expref: 25 pid: 6538 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.242027:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:1.0:1788658471.242032:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.242041:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.242048:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.242076:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658471.242123:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:2397:x1875544001008128:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 172us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658471.242130:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00010000:00010000:0.0:1788658471.243385:0:7958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.243405:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658471.243427:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788658471.243562:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6ef8b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc81a expref: 25 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.243582:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc81a expref: 24 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.243591:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:0.0:1788658471.243594:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658471.243597:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031800, rc 0) 00000100:00100000:0.0:1788658471.243655:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:10832:x1875544001008000:12345-192.168.202.53@tcp:101:bash.0 Request processed in 6892us (7093us total) trans 4294967368 rc 0/0 00000100:00100000:0.0:1788658471.243663:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:1.0:1788658471.251135:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658471.252951:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001008256 00000100:00100000:2.0:1788658471.252965:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001008256 00000100:00100000:2.0:1788658471.253073:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 99 00000100:00100000:2.0:1788658471.253085:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:10832:x1875544001008256:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658471.253109:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658471.253130:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6efa0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc821 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.253175:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6efa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.253190:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6efa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.253201:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6efa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.253310:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6efa0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc821 expref: 26 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.253327:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6efa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc821 expref: 25 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.253336:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658471.253339:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788658471.253342:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1600, rc 0) 00000100:00100000:2.0:1788658471.253411:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:10832:x1875544001008256:12345-192.168.202.53@tcp:101:bash.0 Request processed in 328us (2286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658471.253420:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 99 00000100:00100000:3.0:1788658471.260252:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.260339:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001008512 00000100:00100000:0.0:1788658471.260351:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001008512 00000100:00100000:0.0:1788658471.260408:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 100 00000100:00100000:0.0:1788658471.260419:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:10832:x1875544001008512:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:0.0:1788658471.260677:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.260696:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.260739:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658471.260805:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1788658471.260829:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074ff4276 reply state 000000000c8a7da8 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.260842:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.260849:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:0.0:1788658471.260852:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658471.260856:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788658471.260945:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1788658471.261050:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:10832:x1875544001008512:12345-192.168.202.53@tcp:36:bash.0 Request processed in 633us (809us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788658471.261057:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 100 00000020:00080000:0.0:1788658471.261061:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788658471.271150:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.271299:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001008640 00000100:00100000:0.0:1788658471.271310:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001008640 00000100:00100000:0.0:1788658471.271376:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 101 00000100:00100000:0.0:1788658471.271386:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:10832:x1875544001008640:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658471.271413:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658471.271434:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6efb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc828 expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.271496:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6efb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc828 expref: 30 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.271513:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6efb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc828 expref: 30 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.271547:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:0.0:1788658471.271551:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658471.271555:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391c00, rc 0) 00000100:00100000:0.0:1788658471.271614:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:10832:x1875544001008640:12345-192.168.202.53@tcp:101:bash.0 Request processed in 229us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658471.271621:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 101 00000100:00100000:1.0:1788658471.277365:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658471.277645:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001008768 00000100:00100000:2.0:1788658471.277656:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001008768 00000100:00100000:2.0:1788658471.277736:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:2.0:1788658471.277747:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:10832:x1875544001008768:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658471.277776:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658471.277800:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e878865/0x48e67cc629c6efbc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc82f expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658471.277840:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9cc325, atime: 0x6a9cc323, ctime: 0x6a9cc325, blocks: 0x8 00010000:00010000:2.0:1788658471.277863:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=388s v=(0 0) 00010000:00010000:2.0:1788658471.277868:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658471.277876:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e878865/0x48e67cc629c6efbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc82f expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.277895:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e878865/0x48e67cc629c6efbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc82f expref: 7 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.277907:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1200, rc 0) 00000100:00100000:2.0:1788658471.277964:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:10832:x1875544001008768:12345-192.168.202.53@tcp:101:bash.0 Request processed in 218us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658471.277987:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:1.0:1788658471.282435:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.283134:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001008896 00000100:00100000:3.0:1788658471.283144:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001008896 00002000:00010000:3.0:1788658471.283186:0:8457:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788658471.283191:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d83d51880 with x1875544001008896 ext(0->18446744073709551615) 00002000:00010000:3.0:1788658471.283202:0:8457:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1d83d51880. 00000100:00100000:3.0:1788658471.283338:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:3.0:1788658471.283349:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001008896:12345-192.168.202.53@tcp:10:bash.0 00002000:00010000:3.0:1788658471.283804:0:8457:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788658471.283808:0:8457:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788658469 -> 1788658470 00002000:00010000:3.0:1788658471.283811:0:8457:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788658467 -> 1788658467 00002000:00010000:3.0:1788658471.283812:0:8457:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788658469 -> 1788658470 00002000:00010000:3.0:1788658471.283814:0:8457:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788658471.283873:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2397:x1875544001008896:12345-192.168.202.53@tcp:10:bash.0 Request processed in 525us (1448us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788658471.283881:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00002000:00010000:3.0:1788658471.283884:0:8457:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:3.0:1788658471.283887:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d83d51880 with x1875544001008896 ext(0->18446744073709551615) 00002000:00010000:3.0:1788658471.283891:0:8457:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1d83d51880. 00000100:00100000:1.0:1788658471.355980:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658471.356031:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001009024 00000100:00100000:2.0:1788658471.356042:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001009024 00000100:00100000:2.0:1788658471.356105:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 102 00000100:00100000:2.0:1788658471.356116:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11322:x1875544001009024:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:2.0:1788658471.356189:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6efc3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356212:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6efc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356223:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6efc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356251:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6efca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356256:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6efca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356260:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6efca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356322:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356328:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356331:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658471.356366:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356373:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6efc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356377:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6efc3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356383:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6efc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356389:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658471.356393:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6efc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356407:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6efc3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356419:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:2.0:1788658471.356422:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658471.356427:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6efc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356434:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6efc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356448:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6efca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356452:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6efca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356456:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6efca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356458:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658471.356460:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6efca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356463:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6efca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356468:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1d83406a00) 00010000:00010000:2.0:1788658471.356469:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658471.356471:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6efca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356481:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6efca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356494:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356497:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356501:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356504:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658471.356506:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356509:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356513:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658471.356514:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658471.356516:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.356519:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6efd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658471.356579:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11322:x1875544001009024:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 465us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658471.356587:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 102 00000100:00100000:1.0:1788658471.358862:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788658471.358883:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025208832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788658471.359015:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658471.359265:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658471.359369:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025208960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658471.359407:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658471.359592:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025208832 00000100:00100000:3.0:1788658471.359600:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025208832 00000100:00100000:3.0:1788658471.359655:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025208960 00000100:00100000:3.0:1788658471.359658:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025208960 00000100:00100000:3.0:1788658471.359674:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788658471.359682:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875544025208832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658471.359728:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788658471.359740:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658471.359825:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875544025208832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658471.359833:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788658471.359850:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788658471.359856:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025208960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658471.359866:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658471.359893:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025208960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658471.360114:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788658471.360187:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025208832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658471.360200:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025208960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658471.405227:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.405343:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001009280 00000100:00100000:0.0:1788658471.405353:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001009280 00000100:00100000:0.0:1788658471.405411:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 103 00000100:00100000:0.0:1788658471.405421:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11325:x1875544001009280:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658471.405440:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658471.405460:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6efd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc836 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.405528:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6efdf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.405543:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6efdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.405555:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6efdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.405571:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6efe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.405578:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6efe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.405600:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6efe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.405779:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6efed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.405791:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6efed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.405798:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6efed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658471.405808:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788658471.405964:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6efdf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.405972:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6efdf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.405978:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6efdf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.405984:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658471.405989:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6efdf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.405996:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6efdf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406007:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:2.0:1788658471.406010:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658471.406015:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6efdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406021:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c6efdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406045:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6efe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406052:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6efe6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406058:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6efe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406070:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658471.406073:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6efe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406081:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6efe6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406089:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e70100) 00010000:00010000:2.0:1788658471.406092:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658471.406095:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6efe6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406101:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c6efe6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406139:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c6efd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc836 expref: 33 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406151:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6efed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc836 expref: 32 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.406159:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658471.406162:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788658471.406164:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670a00, rc 0) 00000100:00100000:2.0:1788658471.406219:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:11325:x1875544001009280:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 800us (1003us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788658471.406226:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 103 00000100:00100000:1.0:1788658471.412847:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658471.416229:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001009408 00000100:00100000:2.0:1788658471.416264:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001009408 00000100:00100000:2.0:1788658471.416354:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 104 00000100:00100000:2.0:1788658471.416370:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:11325:x1875544001009408:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:2.0:1788658471.416451:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.416469:0:11974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc81a expref: 32 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.416480:0:11974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.416518:0:11974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc81a expref: 32 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.416533:0:11974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc81a expref: 32 pid: 7958 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658471.416548:0:11974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e26d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025209088:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658471.416691:0:11974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead8f5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658471.420381:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.420454:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001009664 00000100:00100000:3.0:1788658471.420465:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001009664 00000100:00100000:3.0:1788658471.420527:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1788658471.420536:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+33:6169:x1875544001009664:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788658471.422132:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+34:6169:x1875544001009664:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 1585us (1751us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788658471.422145:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:2.0:1788658471.422282:0:11974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e26d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025209088:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658471.422318:0:11974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658471.424540:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.424734:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001009792 00000100:00100000:3.0:1788658471.424761:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001009792 00010000:00010000:3.0:1788658471.425035:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc81a expref: 34 pid: 7958 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658471.425083:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:3.0:1788658471.425093:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+34:2396:x1875544001009792:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658471.425108:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658471.425114:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc81a expref: 34 pid: 7958 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.425130:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc81a expref: 34 pid: 7958 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.425152:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6ef92 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc81a expref: 34 pid: 7958 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.425172:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658471.425186:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.425196:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.425202:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.425234:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658471.425282:0:11974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.425292:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658471.425301:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+33:2396:x1875544001009792:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 209us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658471.425309:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 66 00010000:00010000:0.0:1788658471.425344:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.425353:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.425358:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.425363:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658471.425367:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.426258:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.426272:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:0.0:1788658471.426274:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658471.426278:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.426283:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6effb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658471.426356:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:11325:x1875544001009408:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 9982us (13512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658471.426365:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 104 00000100:00100000:1.0:1788658471.428204:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.428249:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001010048 00000100:00100000:0.0:1788658471.428262:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001010048 00000100:00100000:0.0:1788658471.428384:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:0.0:1788658471.428393:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:11325:x1875544001010048:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1788658471.428867:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+33:11325:x1875544001010048:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 472us (669us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788658471.428875:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:3.0:1788658471.489620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.489803:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001010304 00000100:00100000:0.0:1788658471.489818:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001010304 00000100:00100000:0.0:1788658471.489893:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 105 00000100:00100000:0.0:1788658471.489903:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+33:11336:x1875544001010304:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:0.0:1788658471.489937:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658471.489965:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f002 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc83d expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490126:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f009 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490142:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f009 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490152:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f009 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490168:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f010 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490176:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490183:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490319:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f017 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490329:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490336:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f017 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658471.490347:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788658471.490536:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f009 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490543:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f009 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490553:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f009 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490558:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658471.490562:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f009 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490570:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f009 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490585:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658471.490588:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658471.490594:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f009 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490600:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f009 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490619:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f010 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490625:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f010 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490631:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490635:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658471.490964:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f010 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490984:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f010 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.490993:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e70e00) 00010000:00010000:0.0:1788658471.490996:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658471.490999:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f010 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.491004:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f010 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.491063:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f002 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc83d expref: 36 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.491089:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f017 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc83d expref: 35 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.491098:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:0.0:1788658471.491101:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658471.491103:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671400, rc 0) 00000100:00100000:0.0:1788658471.491197:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:11336:x1875544001010304:12345-192.168.202.53@tcp:101:cat.0 Request processed in 1293us (1591us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788658471.491206:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 105 00000100:00100000:1.0:1788658471.501573:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.502309:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001010560 00000100:00100000:3.0:1788658471.502322:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001010560 00000100:00100000:3.0:1788658471.502377:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:3.0:1788658471.502386:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:11336:x1875544001010560:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:3.0:1788658471.502682:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+36:11336:x1875544001010560:12345-192.168.202.53@tcp:35:cat.0 Request processed in 295us (1123us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788658471.502691:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:2.0:1788658471.537978:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.538398:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001010816 00000100:00100000:3.0:1788658471.538414:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001010816 00000100:00100000:3.0:1788658471.538481:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 106 00000100:00100000:3.0:1788658471.538494:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+36:11337:x1875544001010816:12345-192.168.202.53@tcp:36:rm.0 00010000:00010000:3.0:1788658471.538553:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788658471.538581:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391c00/0x48e67cc629c6efb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc828 expref: 36 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.538626:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f017 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc83d expref: 35 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.538641:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6efed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc836 expref: 34 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.538654:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6efa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc821 expref: 33 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.538665:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658471.538670:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658471.538693:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f025 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.538966:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f025 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.538980:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f025 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.538997:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.539005:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.539520:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.539626:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f033 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.539636:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.539643:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658471.542571:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:3.0:1788658471.542644:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542661:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542674:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542683:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542689:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542695:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542752:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658471.542781:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f033 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542804:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f033 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542811:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f033 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542816:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658471.542821:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f033 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542829:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f033 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542841:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658471.542844:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788658471.542848:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f033 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542854:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f033 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542879:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f025 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542885:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f025 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542891:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f025 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542896:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658471.542906:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f025 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542912:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f025 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542921:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658471.542924:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658471.542927:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f025 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542934:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f025 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658471.542946:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004f2286b reply state 00000000805aaa8e transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542957:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.542963:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e7e100) 00010000:00010000:3.0:1788658471.542966:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658471.542969:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658471.543067:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+34:11337:x1875544001010816:12345-192.168.202.53@tcp:36:rm.0 Request processed in 4572us (5099us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788658471.543077:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 106 00010000:00010000:2.0:1788658471.546188:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658471.546201:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.546230:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658471.546235:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.546246:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.546264:0:7486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658471.546267:0:7486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788658471.546272:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.546279:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f03a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.546298:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658471.546300:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658471.546302:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658471.583442:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.583612:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001011072 00000100:00100000:0.0:1788658471.583622:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001011072 00000100:00100000:0.0:1788658471.583685:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 107 00000100:00100000:0.0:1788658471.583696:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+34:11343:x1875544001011072:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658471.583777:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658471.584096:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f041 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc844 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.584201:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f048 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.584216:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f048 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.584229:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f048 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.584240:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.584247:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.584253:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658471.585196:0:11974:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788658471.585356:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.585630:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.585644:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.585699:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f048 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.586129:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f048 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.586137:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f048 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.586142:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658471.586147:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f048 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.586156:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f048 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.586169:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658471.586172:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658471.586176:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f048 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.586183:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f048 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658471.586198:0:11974:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9e47925 reply state 00000000fb011b0b transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.586209:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.586216:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e7e100) 00010000:00010000:0.0:1788658471.586225:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658471.586228:0:11974:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788658471.586263:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f041 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc844 expref: 37 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.586278:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc844 expref: 36 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.586286:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:0.0:1788658471.586288:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658471.586291:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671a00, rc 0) 00000100:00100000:0.0:1788658471.586440:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+37:11343:x1875544001011072:12345-192.168.202.53@tcp:101:bash.0 Request processed in 2745us (3008us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788658471.586450:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 107 00000100:00100000:1.0:1788658471.607237:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.607492:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001011200 00000100:00100000:0.0:1788658471.607501:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001011200 00000100:00100000:0.0:1788658471.607563:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:0.0:1788658471.607571:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2398:x1875544001011200:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658471.607586:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658471.607601:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f1cff9a/0x48e67cc629c6f064 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc84b expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658471.607636:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658471.607658:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=388s v=(0 0) 00010000:00010000:0.0:1788658471.607663:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658471.607673:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f1cff9a/0x48e67cc629c6f064 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc84b expref: 8 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.607766:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f1cff9a/0x48e67cc629c6f064 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc84b expref: 8 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.607967:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670600, rc 0) 00000100:00100000:0.0:1788658471.608029:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2398:x1875544001011200:12345-192.168.202.53@tcp:101:bash.0 Request processed in 459us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658471.608035:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00080000:1.0:1788658471.609027:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658471.611059:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.611205:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001011328 00000100:00100000:3.0:1788658471.611217:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001011328 00000100:00100000:3.0:1788658471.611272:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:3.0:1788658471.611283:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:11343:x1875544001011328:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1788658471.611300:0:13833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658471.611332:0:13833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc852 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.611363:0:13833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f1cff9a/0x48e67cc629c6f064 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc84b expref: 9 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.611372:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658471.611376:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658471.611382:0:13833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 9 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.611418:0:13833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f1cff9a/0x48e67cc629c6f064 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc84b expref: 9 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.611433:0:13833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f1cff9a/0x48e67cc629c6f064 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc84b expref: 9 pid: 8454 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658471.611447:0:13833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13833:1875544025209216:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658471.611560:0:13833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788658471.625187:0:13833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e59500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13833:1875544025209216:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658471.625228:0:13833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 9 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.625249:0:13833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031800, rc 0) 00000100:00100000:3.0:1788658471.625310:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:11343:x1875544001011328:12345-192.168.202.53@tcp:101:bash.0 Request processed in 14028us (14257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658471.625337:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:1.0:1788658471.629188:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.632888:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001011456 00000100:00100000:0.0:1788658471.632904:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001011456 00010000:00010000:0.0:1788658471.632958:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f1cff9a/0x48e67cc629c6f064 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc84b expref: 9 pid: 8454 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658471.632996:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:0.0:1788658471.633007:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2397:x1875544001011456:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658471.633022:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658471.633044:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f1cff9a/0x48e67cc629c6f064 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc84b expref: 9 pid: 8454 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.633058:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f1cff9a/0x48e67cc629c6f064 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc84b expref: 9 pid: 8454 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.633082:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f1cff9a/0x48e67cc629c6f064 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc84b expref: 9 pid: 8454 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.633122:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658471.633126:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658471.633142:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 8 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.633151:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 8 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.633194:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 8 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658471.633207:0:6523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83df6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6523:1875544025209344:192.168.202.53@tcp:105: 00000100:00100000:0.0:1788658471.633303:0:6523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658471.636795:0:6523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83df6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6523:1875544025209344:192.168.202.53@tcp:105: 00010000:00010000:0.0:1788658471.636823:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658471.636874:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2397:x1875544001011456:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 3868us (7696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658471.636886:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:2.0:1788658471.640993:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.641091:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001011712 00000100:00100000:0.0:1788658471.641102:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001011712 00000100:00100000:0.0:1788658471.641170:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:0.0:1788658471.641182:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+37:11343:x1875544001011712:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:1.0:1788658471.650264:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:11343:x1875544001011712:12345-192.168.202.53@tcp:35:bash.0 Request processed in 9070us (9267us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788658471.650281:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1788658471.865964:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.866264:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001011840 00000100:00100000:0.0:1788658471.866275:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001011840 00000100:00100000:0.0:1788658471.866367:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:0.0:1788658471.866390:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:11359:x1875544001011840:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658471.866418:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658471.866440:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc859 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.866508:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f079 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.866521:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.866537:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658471.866582:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788658471.866596:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658471.866619:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.866644:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc859 expref: 40 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.866663:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc859 expref: 39 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.866672:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658471.866675:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658471.866679:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670c00, rc 0) 00000100:00100000:0.0:1788658471.866812:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:11359:x1875544001011840:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 435us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658471.866828:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:3.0:1788658471.871364:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658471.871389:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025209472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658471.871470:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658471.871609:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025209472 00000100:00100000:1.0:1788658471.871618:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025209472 00000100:00100000:1.0:1788658471.871671:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788658471.871681:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025209472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788658471.871755:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788658471.871806:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025209472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658471.871814:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788658471.871982:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025209472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658471.878102:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.878500:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001012096 00000100:00100000:3.0:1788658471.878511:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001012096 00000100:00100000:3.0:1788658471.878574:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 109 00000100:00100000:3.0:1788658471.878593:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:11359:x1875544001012096:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658471.878611:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658471.878632:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f080 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc860 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.878794:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f087 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.878809:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f087 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.878822:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f087 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658471.878833:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788658471.878932:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f080 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc860 expref: 42 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.878953:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f087 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc860 expref: 41 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.879105:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:3.0:1788658471.879109:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658471.879113:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80030400, rc 0) 00000100:00100000:3.0:1788658471.879184:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+41:11359:x1875544001012096:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 600us (1091us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788658471.879192:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 109 00000100:00100000:3.0:1788658471.884824:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.884927:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001012352 00000100:00100000:0.0:1788658471.884937:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001012352 00000100:00100000:0.0:1788658471.885000:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 110 00000100:00100000:0.0:1788658471.885011:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+41:11359:x1875544001012352:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658471.885034:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658471.885054:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f095 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc867 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.885152:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f09c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.885166:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.885177:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f09c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658471.885190:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788658471.885293:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f095 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc867 expref: 44 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.885311:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f09c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc867 expref: 43 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.885319:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:0.0:1788658471.885322:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788658471.885325:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670e00, rc 0) 00000100:00100000:0.0:1788658471.885402:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:11359:x1875544001012352:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 392us (589us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1788658471.885409:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 110 00000100:00100000:1.0:1788658471.890120:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.890213:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001012480 00000100:00100000:3.0:1788658471.890223:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001012480 00000100:00100000:3.0:1788658471.890297:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:3.0:1788658471.890307:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:2396:x1875544001012480:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658471.890323:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658471.890349:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f087 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc860 expref: 43 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.890368:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:3.0:1788658471.890375:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658471.890451:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+42:2396:x1875544001012480:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 145us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658471.890459:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1788658471.894929:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658471.895088:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001012608 00000100:00100000:1.0:1788658471.895102:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001012608 00000100:00100000:1.0:1788658471.895169:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:1.0:1788658471.895200:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2398:x1875544001012608:12345-192.168.202.53@tcp:1:lfs.0 00010000:00010000:1.0:1788658471.895251:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.895271:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 8 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.895279:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788658471.895283:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658471.895289:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.895327:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 8 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.895341:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 8 pid: 13833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658471.895357:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8452:1875544025209600:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658471.895473:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658471.903224:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8452:1875544025209600:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658471.903257:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658471.904350:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658471.904443:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001012736 00000100:00100000:0.0:1788658471.904451:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001012736 00002000:00100000:0.0:1788658471.904500:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8a1e812a9f80 x1875544001012736/t0(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:62/0 lens 504/0 e 0 to 0 dl 1788658482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658471.904511:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1e812a9f80 with x1875544001012736 ext(0->8) 00010000:00010000:0.0:1788658471.904520:0:8459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 9 pid: 13833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.904535:0:8459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 9 pid: 13833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658471.904543:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a1e812a9f80 00000100:00100000:0.0:1788658471.904579:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:0.0:1788658471.904595:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2397:x1875544001012736:12345-192.168.202.53@tcp:4:lfs.0 00000100:00100000:0.0:1788658471.906158:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:2397:x1875544001012736:12345-192.168.202.53@tcp:4:lfs.0 Request processed in 1556us (1805us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788658471.906169:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00002000:00100000:0.0:1788658471.906179:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8a1e812a9f80 x1875544001012736/t4294967303(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:62/0 lens 504/448 e 0 to 0 dl 1788658482 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658471.906198:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1e812a9f80 with x1875544001012736 ext(0->8) 00010000:00010000:0.0:1788658471.906206:0:8459:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 11 pid: 13833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658471.906222:0:8459:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 11 pid: 13833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658471.906229:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a1e812a9f80 00000100:00100000:1.0:1788658471.909622:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658471.909736:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001012864 00000100:00100000:2.0:1788658471.909747:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001012864 00010000:00010000:2.0:1788658471.909788:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 11 pid: 13833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658471.909832:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:2.0:1788658471.909857:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:2398:x1875544001012864:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658471.909873:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788658471.909894:0:6522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788658471.909897:0:6522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788658471 00002000:00010000:2.0:1788658471.909899:0:6522:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788658471 00002000:00010000:2.0:1788658471.909901:0:6522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788658471 00002000:00010000:2.0:1788658471.909903:0:6522:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788658471.909909:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 11 pid: 13833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.909923:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 11 pid: 13833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.909949:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a45e88e/0x48e67cc629c6f06b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc852 expref: 11 pid: 13833 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.909981:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658471.909986:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658471.909994:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.910003:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658471.910037:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658471.910098:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae3b8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:2398:x1875544001012864:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 242us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658471.910115:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 68 00010000:00010000:1.0:1788658471.910274:0:8452:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.910284:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.910319:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.910328:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.910336:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.910342:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658471.910346:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.910354:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.910366:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.910374:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008adba288/0x48e67cc629c6f0aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658471.910435:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2398:x1875544001012608:12345-192.168.202.53@tcp:1:lfs.0 Request processed in 15240us (15518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658471.910443:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:1.0:1788658471.913805:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.913961:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001013120 00000100:00100000:3.0:1788658471.913970:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001013120 00000100:00100000:3.0:1788658471.914036:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:3.0:1788658471.914046:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+42:11359:x1875544001013120:12345-192.168.202.53@tcp:35:lfs.0 00000004:00010000:3.0:1788658471.914109:0:13563:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f09c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc867 expref: 42 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658471.914339:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788658471.914372:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788658471.914790:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1788658471.914830:0:13563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.914845:0:13563:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc844 expref: 46 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.914854:0:13563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.914887:0:13563:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc844 expref: 46 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.914902:0:13563:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc844 expref: 46 pid: 11974 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658471.914916:0:13563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e58700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13563:1875544025209728:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658471.915001:0:13563:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658471.918443:0:13563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e58700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:13563:1875544025209728:192.168.202.53@tcp:104: 00010000:00010000:1.0:1788658471.918476:0:13563:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658471.920020:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.920306:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001013248 00000100:00100000:3.0:1788658471.920315:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001013248 00010000:00010000:3.0:1788658471.920357:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc844 expref: 47 pid: 11974 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658471.920401:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:3.0:1788658471.920411:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+47:2397:x1875544001013248:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658471.920441:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658471.920449:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc844 expref: 47 pid: 11974 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.920462:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc844 expref: 47 pid: 11974 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.920483:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f056 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc844 expref: 47 pid: 11974 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.920500:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:3.0:1788658471.920506:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.920515:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.920523:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.920552:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658471.920732:0:13563:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658471.920741:0:13563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658471.920863:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788658471.921201:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+47:2397:x1875544001013248:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 789us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658471.921210:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00000001:00080000:1.0:1788658471.921322:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1788658471.921416:0:13563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13563:1875544025209856:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788658471.921467:0:13563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658471.921505:0:13563:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658471.921560:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025209856 00000100:00100000:2.0:1788658471.921566:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025209856 00000100:00100000:2.0:1788658471.921616:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788658471.921624:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13563:x1875544025209856:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788658471.921753:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:13563:x1875544025209856:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 130us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658471.921760:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788658471.921887:0:13563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13563:1875544025209856:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1788658471.922026:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1788658471.922070:0:13563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13563:1875544025209984:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1788658471.922103:0:13563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658471.922142:0:13563:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8133a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658471.922262:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025209984 00000100:00100000:2.0:1788658471.922267:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025209984 00000100:00100000:2.0:1788658471.922306:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788658471.922314:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:13563:x1875544025209984:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788658471.922413:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:13563:x1875544025209984:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 99us (308us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788658471.922421:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788658471.922594:0:13563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e58380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:13563:1875544025209984:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:3.0:1788658471.922647:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1788658471.922689:0:13563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.922728:0:13563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.922737:0:13563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.922743:0:13563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658471.922748:0:13563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.922756:0:13563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.922770:0:13563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:3.0:1788658471.922773:0:13563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788658471.922777:0:13563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.922783:0:13563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658471.922877:0:13563:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788658471.922939:0:13563:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1788658471.922951:0:13563:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389139247112ns, next at 390139244720ns, rc = 0 00000001:00080000:3.0:1788658471.922957:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1788658471.923187:0:13563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:3.0:1788658471.923191:0:13563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788658471.923198:0:13563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f09c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc867 expref: 50 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658471.923286:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+49:11359:x1875544001013120:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 9240us (9490us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788658471.923294:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 26 00000020:00080000:3.0:1788658471.923298:0:13563:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788658471.927308:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658471.927512:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001013376 00000100:00100000:3.0:1788658471.927522:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001013376 00000100:00100000:3.0:1788658471.927745:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 111 00000100:00100000:3.0:1788658471.927757:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+49:11359:x1875544001013376:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658471.927781:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658471.927804:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f0b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc86e expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.927864:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f0b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc86e expref: 50 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.927879:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f0b8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc86e expref: 50 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658471.927897:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658471.927900:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658471.927904:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031200, rc 0) 00000100:00100000:3.0:1788658471.927961:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+50:11359:x1875544001013376:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 206us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658471.927996:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 111 00000100:00100000:0.0:1788658471.932462:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658471.932566:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001013632 00000100:00100000:1.0:1788658471.932643:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001013632 00000100:00100000:1.0:1788658471.932881:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:1.0:1788658471.932893:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+50:11359:x1875544001013632:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658471.933240:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+51:11359:x1875544001013632:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 349us (788us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788658471.933249:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:1.0:1788658472.098080:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.098170:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001013760 00000100:00100000:3.0:1788658472.098180:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001013760 00000100:00100000:3.0:1788658472.098241:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 112 00000100:00100000:3.0:1788658472.098252:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+51:11369:x1875544001013760:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:3.0:1788658472.098331:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f0bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098349:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f0bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098362:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f0bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098376:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098384:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098391:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098468:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098476:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098482:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658472.098556:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098584:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f0bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098591:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f0bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098597:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f0bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098603:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658472.098608:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f0bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098615:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f0bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098627:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658472.098629:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658472.098634:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f0bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098641:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f0bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098658:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098675:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098687:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098692:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658472.098694:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098772:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098783:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e7e100) 00010000:00010000:3.0:1788658472.098785:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658472.098789:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098794:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f0c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098805:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098811:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098817:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098822:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658472.098824:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098841:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098849:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658472.098851:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658472.098854:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.098860:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658472.098933:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+51:11369:x1875544001013760:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 681us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658472.098942:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 112 00000100:00100000:3.0:1788658472.166183:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658472.166364:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001014016 00000100:00100000:0.0:1788658472.166374:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001014016 00000100:00100000:0.0:1788658472.166448:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:0.0:1788658472.166459:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+51:11372:x1875544001014016:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658472.166478:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658472.166498:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f0d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc875 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166582:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f0db lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166597:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f0db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166609:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f0db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166621:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f0e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166643:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166651:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166807:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f0e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166816:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166823:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658472.166833:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788658472.166909:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f0db lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166916:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f0db lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166922:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f0db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166928:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658472.166932:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f0db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166938:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f0db lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166964:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658472.166967:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658472.166971:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f0db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166977:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f0db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166991:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.166997:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f0e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.167004:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.167009:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658472.167013:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.167019:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f0e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.167026:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e7e100) 00010000:00010000:0.0:1788658472.167029:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658472.167032:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f0e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.167037:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f0e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.167082:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f0d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc875 expref: 54 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.167099:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc875 expref: 53 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.167106:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:0.0:1788658472.167108:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658472.167111:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671400, rc 0) 00000100:00100000:0.0:1788658472.167299:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+53:11372:x1875544001014016:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 841us (1125us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788658472.167308:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:0.0:1788658472.174081:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.174271:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001014144 00000100:00100000:3.0:1788658472.174281:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001014144 00000100:00100000:3.0:1788658472.174584:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 114 00000100:00100000:3.0:1788658472.174597:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+53:11372:x1875544001014144:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:3.0:1788658472.174680:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.174698:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.174746:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.174782:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.174806:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.174812:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.174817:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658472.174822:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.174830:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.174842:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658472.174845:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658472.174850:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.174856:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f0f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658472.174950:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+53:11372:x1875544001014144:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 355us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658472.174957:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 114 00000100:00100000:0.0:1788658472.178583:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.178731:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001014400 00000100:00100000:3.0:1788658472.178741:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001014400 00000100:00100000:3.0:1788658472.178797:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:3.0:1788658472.178808:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+53:11372:x1875544001014400:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:3.0:1788658472.179182:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+54:11372:x1875544001014400:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 373us (606us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1788658472.179202:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:0.0:1788658472.282293:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.282415:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001014656 00000100:00100000:2.0:1788658472.282425:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001014656 00000100:00100000:2.0:1788658472.282488:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 115 00000100:00100000:2.0:1788658472.282499:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+54:11382:x1875544001014656:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658472.282525:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658472.282530:0:11974:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788658472.282570:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f079 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc859 expref: 54 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.282593:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:2.0:1788658472.282614:0:11974:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658472.282630:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f0fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc87c expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.282808:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.282823:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.282833:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658472.282844:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788658472.283187:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f0fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc87c expref: 56 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.283205:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc87c expref: 55 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.283213:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658472.283216:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658472.283218:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1a00, rc 0) 00000100:00100000:2.0:1788658472.283280:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+55:11382:x1875544001014656:12345-192.168.202.53@tcp:101:bash.0 Request processed in 783us (999us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788658472.283288:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 115 00000100:00100000:0.0:1788658472.288025:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.288115:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001014784 00000100:00100000:3.0:1788658472.288124:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001014784 00000100:00100000:3.0:1788658472.288186:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 116 00000100:00100000:3.0:1788658472.288197:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+55:11382:x1875544001014784:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1788658472.288226:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658472.288247:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f113 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc883 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.288281:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.288296:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.288308:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.288436:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f113 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc883 expref: 57 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.288457:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc883 expref: 56 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.288467:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658472.288470:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658472.288474:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80030400, rc 0) 00000100:00100000:3.0:1788658472.288536:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+56:11382:x1875544001014784:12345-192.168.202.53@tcp:101:bash.0 Request processed in 341us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658472.288552:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 116 00000100:00100000:0.0:1788658472.292891:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.293446:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001015040 00000100:00100000:3.0:1788658472.293456:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001015040 00000100:00100000:3.0:1788658472.293524:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:3.0:1788658472.293534:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+56:11382:x1875544001015040:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:3.0:1788658472.293594:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788658472.293623:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc87c expref: 56 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.293659:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f0e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc875 expref: 55 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.293674:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658472.293680:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658472.293999:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.294016:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.294026:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658472.294072:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1788658472.294102:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002ddc454c reply state 0000000061bc5bc2 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.294115:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.294139:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658472.294142:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658472.294145:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658472.294257:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+57:11382:x1875544001015040:12345-192.168.202.53@tcp:36:bash.0 Request processed in 724us (1379us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788658472.294265:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 117 00000020:00080000:3.0:1788658472.294270:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788658472.300847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.300981:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001015168 00000100:00100000:2.0:1788658472.300990:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001015168 00000100:00100000:2.0:1788658472.301053:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:2.0:1788658472.301064:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+57:11382:x1875544001015168:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658472.301098:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658472.301118:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f128 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc88a expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.301204:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.301219:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.301229:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658472.301254:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788658472.301258:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658472.301276:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.301301:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f128 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc88a expref: 59 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.301320:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc88a expref: 58 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.301328:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658472.301331:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658472.301335:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1800, rc 0) 00000100:00100000:2.0:1788658472.301406:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+58:11382:x1875544001015168:12345-192.168.202.53@tcp:101:bash.0 Request processed in 344us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658472.301413:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:1.0:1788658472.305459:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.305555:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001015424 00000100:00100000:2.0:1788658472.305565:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001015424 00000100:00100000:2.0:1788658472.305624:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:2.0:1788658472.305634:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+58:11382:x1875544001015424:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1788658472.305902:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+59:11382:x1875544001015424:12345-192.168.202.53@tcp:35:bash.0 Request processed in 269us (451us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788658472.305909:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00010000:00010000:3.0:1788658472.382886:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658472.391963:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.392115:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001015552 00000100:00100000:2.0:1788658472.392125:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001015552 00000100:00100000:2.0:1788658472.392189:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 119 00000100:00100000:2.0:1788658472.392201:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+59:11388:x1875544001015552:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658472.392227:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658472.392250:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc891 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.392320:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f13d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.392335:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f13d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.392348:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f13d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658472.392411:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788658472.392416:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658472.392435:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f13d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.392459:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc891 expref: 61 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.392487:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f13d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc891 expref: 60 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.392497:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:2.0:1788658472.392500:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658472.392504:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1600, rc 0) 00000100:00100000:2.0:1788658472.392579:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+60:11388:x1875544001015552:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 381us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658472.392587:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 119 00000100:00100000:3.0:1788658472.396625:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658472.396863:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001015680 00000100:00100000:0.0:1788658472.396873:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001015680 00000100:00100000:0.0:1788658472.396938:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 120 00000100:00100000:0.0:1788658472.396950:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+60:11388:x1875544001015680:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658472.396971:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658472.396992:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f144 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc898 expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397088:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f14b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397102:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f14b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397114:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f14b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397124:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f152 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397131:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397136:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397207:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397217:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397223:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658472.397264:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788658472.397268:0:7958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658472.397286:0:7958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397309:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397318:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f14b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397326:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f14b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397333:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f14b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397340:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658472.397344:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f14b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397352:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f14b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397366:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:0.0:1788658472.397369:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658472.397373:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f14b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397393:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f14b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397406:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f152 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397412:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f152 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397425:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397430:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658472.397433:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f152 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397440:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f152 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397448:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e7e100) 00010000:00010000:0.0:1788658472.397450:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658472.397454:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f152 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397460:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f152 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397488:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f144 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc898 expref: 62 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397502:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc898 expref: 61 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658472.397509:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:0.0:1788658472.397512:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658472.397515:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670600, rc 0) 00000100:00100000:0.0:1788658472.397585:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:11388:x1875544001015680:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 638us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658472.397602:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 120 00000100:00100000:1.0:1788658472.401572:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.401665:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001015936 00000100:00100000:3.0:1788658472.401675:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001015936 00000100:00100000:3.0:1788658472.401762:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:3.0:1788658472.401772:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:11388:x1875544001015936:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658472.401793:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658472.401813:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f160 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc89f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.401933:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.401950:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc88a expref: 62 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.401959:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc898 expref: 62 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.401967:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.402020:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc898 expref: 62 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.402034:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc898 expref: 62 pid: 7958 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658472.402047:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e59c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025210112:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658472.402156:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc88a expref: 62 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.402166:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc88a expref: 62 pid: 11974 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658472.402174:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025210240:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658472.402200:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8133a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658472.403995:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.404082:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001016064 00000100:00100000:2.0:1788658472.404091:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001016064 00010000:00010000:2.0:1788658472.404128:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc898 expref: 63 pid: 7958 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658472.404163:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:2.0:1788658472.404173:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+63:2398:x1875544001016064:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658472.404188:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658472.404196:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc898 expref: 63 pid: 7958 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.404212:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc898 expref: 63 pid: 7958 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.404235:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658472.404241:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.404258:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.404266:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658472.404318:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+63:2398:x1875544001016064:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 146us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658472.404326:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 70 00010000:00010000:3.0:1788658472.408162:0:6537:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.53@tcp) returned -22 from blocking AST (req@0000000075289965 x1875544025210112) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc898 expref: 62 pid: 7958 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.408184:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f159 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc898 expref: 62 pid: 7958 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658472.408200:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e59c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025210112:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658472.408214:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025210240:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658472.408236:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658472.408255:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.408266:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.408275:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658472.411235:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.411319:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001016192 00000100:00100000:3.0:1788658472.411328:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001016192 00010000:00010000:3.0:1788658472.411367:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc88a expref: 62 pid: 11974 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658472.411417:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:3.0:1788658472.411427:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+62:2396:x1875544001016192:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658472.411441:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658472.411448:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc88a expref: 62 pid: 11974 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.411461:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc88a expref: 62 pid: 11974 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.411482:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1800/0x48e67cc629c6f12f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc88a expref: 62 pid: 11974 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.411498:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658472.411504:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.411545:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.411553:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.411584:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658472.411643:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:2396:x1875544001016192:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 217us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658472.411651:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 71 00010000:00010000:1.0:1788658472.412117:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658472.412126:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658472.412144:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788658472.412275:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f160 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc89f expref: 62 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658472.412294:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc89f expref: 61 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658472.412303:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:1.0:1788658472.412306:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788658472.412308:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031800, rc 0) 00000100:00100000:1.0:1788658472.412345:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:11388:x1875544001015936:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 10574us (10783us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788658472.412353:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:1.0:1788658472.417213:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.417312:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001016448 00000100:00100000:2.0:1788658472.417322:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001016448 00000100:00100000:2.0:1788658472.417399:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1788658472.417410:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:11388:x1875544001016448:12345-192.168.202.53@tcp:103:lfs.0 00010000:00010000:2.0:1788658472.417425:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658472.417450:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f0b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc86e expref: 61 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.417472:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658472.417477:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658472.417689:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+60:11388:x1875544001016448:12345-192.168.202.53@tcp:103:lfs.0 Request processed in 280us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658472.417699:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1788658472.420502:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.420587:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001016576 00000100:00100000:2.0:1788658472.420597:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001016576 00000100:00100000:2.0:1788658472.420689:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:2.0:1788658472.420731:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+60:11388:x1875544001016576:12345-192.168.202.53@tcp:58:lfs.0 00010000:00010000:2.0:1788658472.420860:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.420890:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.420902:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658472.421151:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788658472.421278:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+60:11388:x1875544001016576:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 579us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658472.421287:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:1.0:1788658472.425403:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.425501:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001016704 00000100:00100000:2.0:1788658472.425510:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001016704 00000100:00100000:2.0:1788658472.425581:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:2.0:1788658472.425592:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+60:11388:x1875544001016704:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658472.425615:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658472.425650:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6f17c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8a6 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.425743:0:11974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.425755:0:11974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6f17c lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8a6 expref: 61 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.425773:0:11974:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.425787:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6f17c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8a6 expref: 61 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.425816:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658472.425820:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658472.425824:0:11974:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6f17c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8a6 expref: 61 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.425832:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0c00, rc 0) 00000100:00100000:2.0:1788658472.425884:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:11388:x1875544001016704:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 294us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658472.425891:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 123 00000040:00080000:3.0:1788658472.894961:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788658472.894971:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788658472.894999:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788658472.895007:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788658472.895152:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025210368:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788658472.895281:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658472.900028:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f5f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025210368:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788658472.901909:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658472.902059:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001016832 00000100:00100000:1.0:1788658472.902069:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001016832 00000100:00100000:1.0:1788658472.902170:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 124 00000100:00100000:1.0:1788658472.902181:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:11389:x1875544001016832:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788658472.902214:0:6537:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788658472.902388:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:11389:x1875544001016832:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 208us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658472.902410:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 124 00000100:00100000:1.0:1788658472.907600:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.907760:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001016960 00000100:00100000:2.0:1788658472.907770:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001016960 00000100:00100000:2.0:1788658472.907894:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:2.0:1788658472.907906:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:11389:x1875544001016960:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788658472.907991:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f183 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908007:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f183 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908021:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f183 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908036:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f18a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908043:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f18a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908066:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f18a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908088:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908098:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908104:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658472.908165:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788658472.908170:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658472.908184:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908196:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f183 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908203:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f183 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908210:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f183 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908216:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658472.908220:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f183 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908228:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f183 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908247:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:2.0:1788658472.908250:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658472.908255:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f183 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908262:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f183 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908276:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f18a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908283:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f18a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908289:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f18a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908293:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658472.908304:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f18a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908311:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f18a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908318:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8a1d83406a00) 00010000:00010000:2.0:1788658472.908321:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658472.908332:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f18a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908339:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f18a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908367:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908374:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908379:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908384:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658472.908387:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908394:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908401:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658472.908404:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658472.908407:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.908412:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f191 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658472.908490:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:11389:x1875544001016960:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 585us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658472.908498:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:2.0:1788658472.912928:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.913185:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001017216 00000100:00100000:3.0:1788658472.913207:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001017216 00000100:00100000:3.0:1788658472.913268:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 126 00000100:00100000:3.0:1788658472.913281:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+61:11389:x1875544001017216:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658472.913314:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658472.913335:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f198 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8ad expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.913450:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f19f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.913481:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.913496:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658472.913510:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788658472.913604:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f19f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.913612:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f19f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.913619:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f19f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.913626:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658472.913631:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f19f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.913640:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f19f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.913652:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658472.913655:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788658472.913660:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f19f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.913666:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f19f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.914827:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f198 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8ad expref: 63 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.914954:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:3.0:1788658472.914958:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658472.914964:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f198 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8ad expref: 63 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.914981:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031400, rc 0) 00000100:00100000:3.0:1788658472.915063:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+62:11389:x1875544001017216:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 1784us (2142us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1788658472.915072:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 126 00000100:00100000:3.0:1788658472.917670:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658472.918058:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001017344 00000100:00100000:1.0:1788658472.918068:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001017344 00000100:00100000:1.0:1788658472.918121:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:1.0:1788658472.918132:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+62:11389:x1875544001017344:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788658472.918168:0:6537:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788658472.918285:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+62:11389:x1875544001017344:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 154us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658472.918292:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:1.0:1788658472.924016:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.924460:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001017600 00000100:00100000:2.0:1788658472.924475:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001017600 00000100:00100000:2.0:1788658472.924592:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:2.0:1788658472.924604:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+62:11389:x1875544001017600:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658472.924628:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658472.924631:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788658472.924659:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f13d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc891 expref: 62 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.924677:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:2.0:1788658472.924683:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658472.924696:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f1ad lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8b4 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788658472.925113:0:6538:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788658472.925278:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f1b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.925292:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.925304:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.925368:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f1ad lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8b4 expref: 64 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.925383:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8b4 expref: 63 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.925391:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1d83406a00) 00010000:00010000:2.0:1788658472.925401:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658472.925404:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1400, rc 0) 00000100:00100000:2.0:1788658472.925465:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+63:11389:x1875544001017600:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 863us (1455us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788658472.925473:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:2.0:1788658472.931668:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.931763:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001017856 00000100:00100000:3.0:1788658472.931773:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001017856 00000100:00100000:3.0:1788658472.931828:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:3.0:1788658472.931840:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+63:11389:x1875544001017856:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658472.931899:0:6536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658472.931926:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f1b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8b4 expref: 63 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.931945:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1d83406a00) 00010000:00010000:3.0:1788658472.931957:0:6536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658472.931976:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f1c2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.931989:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f1c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932017:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f1c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932030:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1c9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x1ac41026 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932037:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ac41026 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932042:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ac41026 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932083:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f1c2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932088:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f1c2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932106:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f1c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932112:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658472.932116:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f1c2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932124:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f1c2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932132:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658472.932134:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658472.932139:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f1c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932150:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f1c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932161:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1c9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ac41026 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932167:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1c9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ac41026 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932183:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ac41026 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932188:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658472.932191:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1c9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ac41026 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932198:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1c9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1ac41026 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932205:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x1ac41026 (ffff8a1e90e7e000) 00010000:00010000:3.0:1788658472.932208:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658472.932211:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1c9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1ac41026 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.932217:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1c9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1ac41026 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658472.932291:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+62:11389:x1875544001017856:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 455us (634us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788658472.932298:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:3.0:1788658472.936948:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658472.937106:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001017984 00000100:00100000:1.0:1788658472.937115:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001017984 00000100:00100000:1.0:1788658472.937170:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 130 00000100:00100000:1.0:1788658472.937181:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+62:11389:x1875544001017984:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658472.937201:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658472.937297:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f1d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8bb expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658472.937336:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658472.937350:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658472.937362:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658472.938094:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f1d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8bb expref: 64 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658472.938114:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8bb expref: 63 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658472.938123:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:1.0:1788658472.938127:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788658472.938130:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418000, rc 0) 00000100:00100000:1.0:1788658472.938191:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+63:11389:x1875544001017984:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 1011us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658472.938199:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 130 00000100:00100000:1.0:1788658472.943102:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.943401:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001018240 00000100:00100000:2.0:1788658472.943412:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001018240 00000100:00100000:2.0:1788658472.943478:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:2.0:1788658472.943490:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+63:11389:x1875544001018240:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658472.943585:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.943602:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.943615:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658472.943944:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788658472.943954:0:6538:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 390160250560ns, next at 391160247877ns, rc = 0 00000004:00010000:2.0:1788658472.944000:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078d6f615 reply state 00000000dc90bfad transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.944012:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.944021:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:2.0:1788658472.944023:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788658472.944041:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658472.944135:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+65:11389:x1875544001018240:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 646us (1040us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788658472.944143:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:2.0:1788658472.951109:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.951180:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001018368 00000100:00100000:3.0:1788658472.951188:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001018368 00000100:00100000:3.0:1788658472.951232:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:3.0:1788658472.951240:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+65:11389:x1875544001018368:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658472.951265:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658472.951286:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8c2 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.951343:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c2 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.951354:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c2 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.951368:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:3.0:1788658472.951370:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658472.951373:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031200, rc 0) 00000100:00100000:3.0:1788658472.951471:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:11389:x1875544001018368:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 232us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658472.951477:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:3.0:1788658472.957435:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658472.957782:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001018496 00000100:00100000:0.0:1788658472.957793:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001018496 00000100:00100000:0.0:1788658472.957984:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:0.0:1788658472.957997:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001018496:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788658472.958196:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2396:x1875544001018496:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 201us (767us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788658472.958204:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00080000:1.0:1788658472.958404:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658472.965324:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.965778:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001018752 00000100:00100000:3.0:1788658472.965788:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001018752 00000100:00100000:3.0:1788658472.966126:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:3.0:1788658472.966137:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:11389:x1875544001018752:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788658472.966363:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:11389:x1875544001018752:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 227us (1049us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788658472.966386:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:3.0:1788658472.975966:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658472.976476:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001019008 00000100:00100000:1.0:1788658472.976485:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001019008 00000100:00100000:1.0:1788658472.976534:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 133 00000100:00100000:1.0:1788658472.976541:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:11389:x1875544001019008:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788658472.976665:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:11389:x1875544001019008:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 123us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658472.976672:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 133 00000100:00100000:0.0:1788658472.980067:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658472.980144:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001019136 00000100:00100000:2.0:1788658472.980154:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001019136 00000100:00100000:2.0:1788658472.980211:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 134 00000100:00100000:2.0:1788658472.980222:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:11389:x1875544001019136:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658472.980242:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658472.980265:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f1ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8c9 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.980335:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f1f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.980349:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.980360:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658472.980401:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658472.980420:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.980445:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f1ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c9 expref: 69 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.981295:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c9 expref: 68 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658472.981323:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:2.0:1788658472.981326:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788658472.981330:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0a00, rc 0) 00000100:00100000:2.0:1788658472.981650:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+68:11389:x1875544001019136:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 1424us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658472.981658:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 134 00000100:00100000:2.0:1788658472.985285:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.986185:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001019264 00000100:00100000:3.0:1788658472.986196:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001019264 00000100:00100000:3.0:1788658472.986259:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:3.0:1788658472.986270:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2397:x1875544001019264:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658472.986287:0:13833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658472.986309:0:13833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f3f04a2/0x48e67cc629c6f1fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8d0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658472.986333:0:13833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc328, blocks: 0x0 00010000:00010000:3.0:1788658472.986353:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1788658472.986358:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658472.986368:0:13833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f3f04a2/0x48e67cc629c6f1fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d0 expref: 10 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.986399:0:13833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f3f04a2/0x48e67cc629c6f1fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d0 expref: 10 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658472.986413:0:13833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031400, rc 0) 00000100:00100000:3.0:1788658472.986485:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:2397:x1875544001019264:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 216us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658472.986492:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:2.0:1788658472.998306:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658472.998472:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001019520 00000100:00100000:3.0:1788658472.998482:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001019520 00000100:00100000:3.0:1788658472.998552:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 135 00000100:00100000:3.0:1788658472.998574:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+68:11389:x1875544001019520:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788658472.998683:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+68:11389:x1875544001019520:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 121us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658472.998691:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 135 00000100:00100000:0.0:1788658473.005056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658473.005290:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001019648 00000100:00100000:1.0:1788658473.005301:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001019648 00000100:00100000:1.0:1788658473.005381:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:1.0:1788658473.005394:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:11389:x1875544001019648:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658473.005425:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658473.005444:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8d7 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.005485:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f3f04a2/0x48e67cc629c6f1fa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d0 expref: 11 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.005495:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658473.005499:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658473.005504:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 11 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.005538:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f3f04a2/0x48e67cc629c6f1fa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d0 expref: 11 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.005552:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f3f04a2/0x48e67cc629c6f1fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d0 expref: 11 pid: 13833 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658473.005578:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8452:1875544025210496:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658473.007799:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658473.015156:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658473.017271:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001019776 00000100:00100000:3.0:1788658473.017287:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001019776 00010000:00010000:3.0:1788658473.017338:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f3f04a2/0x48e67cc629c6f1fa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d0 expref: 12 pid: 13833 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658473.017395:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:3.0:1788658473.017407:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+12:2397:x1875544001019776:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658473.017421:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658473.017442:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f3f04a2/0x48e67cc629c6f1fa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d0 expref: 12 pid: 13833 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.017602:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f3f04a2/0x48e67cc629c6f1fa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d0 expref: 12 pid: 13833 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.017628:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658473.017632:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658473.017642:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 12 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.017652:0:9539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 12 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.020783:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f3f04a2/0x48e67cc629c6f1fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d0 expref: 12 pid: 13833 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658473.020812:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8452:1875544025210496:192.168.202.53@tcp:104: 00010000:00010000:1.0:1788658473.021115:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 11 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.021148:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419400, rc 0) 00000100:00100000:1.0:1788658473.021230:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:11389:x1875544001019648:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 15838us (16181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658473.021239:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00010000:00010000:0.0:1788658473.025782:0:9539:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 10 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658473.025812:0:9539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9539:1875544025210624:192.168.202.53@tcp:105: 00000100:00100000:0.0:1788658473.025930:0:9539:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658473.029625:0:9539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9539:1875544025210624:192.168.202.53@tcp:105: 00010000:00010000:0.0:1788658473.029662:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658473.029746:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:2397:x1875544001019776:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 12341us (14599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658473.029757:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:2.0:1788658473.036503:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658473.036637:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001019904 00000100:00100000:3.0:1788658473.036647:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001019904 00002000:00100000:3.0:1788658473.036699:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8a1d83d51f80 x1875544001019904/t0(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:64/0 lens 504/0 e 0 to 0 dl 1788658484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788658473.036747:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d83d51f80 with x1875544001019904 ext(0->12) 00002000:00010000:3.0:1788658473.036753:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1d83d51f80 00000100:00100000:3.0:1788658473.036787:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1788658473.036799:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:2396:x1875544001019904:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788658473.038168:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+12:2396:x1875544001019904:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 Request processed in 1364us (1668us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788658473.038178:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00002000:00100000:3.0:1788658473.038187:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8a1d83d51f80 x1875544001019904/t4294967309(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:64/0 lens 504/448 e 0 to 0 dl 1788658484 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788658473.038198:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d83d51f80 with x1875544001019904 ext(0->12) 00002000:00010000:3.0:1788658473.038203:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1d83d51f80 00000100:00100000:3.0:1788658473.040916:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658473.041037:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001020032 00000100:00100000:1.0:1788658473.041048:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001020032 00000100:00100000:1.0:1788658473.041181:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 136 00000100:00100000:1.0:1788658473.041193:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+68:11389:x1875544001020032:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788658473.043101:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1788658473.043118:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788658473.043156:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788658473.043170:0:6515:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1d8351d900 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788658473.043175:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d835ffa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1d8351d600 00000020:00080000:2.0:1788658473.043178:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d835ff700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1d83debc00 00000020:00080000:2.0:1788658473.043223:0:6515:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1ead8f5900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788658473.043227:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d824f9b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1ead8f5a80 00000020:00080000:2.0:1788658473.043230:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d824f9500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1e83ea1800 00000020:00080000:1.0:1788658473.043443:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788658473.043501:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788658473.043510:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658473.043528:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025211008:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788658473.043598:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658473.043642:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025211008 00000100:00100000:1.0:1788658473.043648:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025211008 00000100:00100000:2.0:1788658473.043696:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025210752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788658473.043750:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658473.043773:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658473.043779:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025210880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788658473.043818:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788658473.043973:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788658473.043978:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658473.043992:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025210752 00000100:00100000:0.0:1788658473.043996:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025210752 00000100:00100000:0.0:1788658473.044039:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025210880 00000100:00100000:0.0:1788658473.044043:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025210880 00000100:00100000:0.0:1788658473.044062:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788658473.044069:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3649:x1875544025210752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788658473.044092:0:8454:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:0.0:1788658473.044118:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.044138:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e878865/0x48e67cc629c6efbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc82f expref: 11 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.044146:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788658473.044151:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658473.044156:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.044180:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e878865/0x48e67cc629c6efbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc82f expref: 11 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.044196:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e878865/0x48e67cc629c6efbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc82f expref: 11 pid: 8453 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658473.044208:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8454:1875544025211136:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658473.044267:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658473.044284:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788658473.044291:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875544025210880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788658473.044396:0:10365:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788658473.044400:0:10365:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788658472 00002000:00010000:0.0:1788658473.044402:0:10365:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788658473.044404:0:10365:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788658472 -> 1788658472 00002000:00010000:0.0:1788658473.044406:0:10365:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788658473.044446:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1875544025210880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (627us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788658473.044464:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1788658473.044506:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1eb7403800/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788658473.044512:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025210880:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788658473.044522:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658473.044732:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11389:x1875544001020032:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 3541us (3825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658473.044740:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 136 00010000:00010000:3.0:1788658473.048865:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.048882:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.048889:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.048914:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658473.048918:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.048926:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.048945:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8a1e90e70400) 00010000:00010000:3.0:1788658473.048948:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658473.048953:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.048959:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c6ef06 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.048988:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.048994:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.048999:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049004:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658473.049007:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049012:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049031:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658473.049034:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658473.049037:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049042:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390e00/0x48e67cc629c6efae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049059:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049065:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049070:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049075:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658473.049077:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049082:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049089:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e7e100) 00010000:00010000:3.0:1788658473.049091:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658473.049094:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049099:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f02c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049123:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049130:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049135:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049140:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658473.049143:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049150:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049157:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e7e100) 00010000:00010000:3.0:1788658473.049159:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658473.049162:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049166:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f04f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049179:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049184:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049189:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049199:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658473.049202:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049207:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049215:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658473.049217:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658473.049220:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049224:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f121 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049235:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049241:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049246:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049250:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658473.049252:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049257:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049272:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:3.0:1788658473.049274:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788658473.049277:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.049283:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f1de lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658473.050253:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658473.050288:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658473.050316:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001020288 00000100:00100000:0.0:1788658473.050324:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001020288 00000100:00100000:0.0:1788658473.050365:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:0.0:1788658473.050394:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+12:2396:x1875544001020288:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788658473.050972:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8454:1875544025211136:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658473.050999:0:8454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658473.051777:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001020160 00000100:00100000:3.0:1788658473.051786:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001020160 00010000:00010000:3.0:1788658473.051819:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e878865/0x48e67cc629c6efbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc82f expref: 13 pid: 8453 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658473.051859:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 73 00000100:00100000:3.0:1788658473.051868:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:2397:x1875544001020160:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658473.051885:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658473.051891:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e878865/0x48e67cc629c6efbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc82f expref: 13 pid: 8453 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.051904:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e878865/0x48e67cc629c6efbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc82f expref: 13 pid: 8453 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.051925:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e878865/0x48e67cc629c6efbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc82f expref: 13 pid: 8453 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.051941:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658473.051956:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658473.051962:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.051971:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.051996:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658473.052050:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+12:2397:x1875544001020160:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 182us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658473.052057:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 73 00010000:00010000:3.0:1788658473.052081:0:8454:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.052088:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.052098:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.052106:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.052122:0:8454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658473.052177:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658473.052184:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.052203:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658473.052208:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.052217:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.052228:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.052236:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a55de33/0x48e67cc629c6f208 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.052256:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658473.052259:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658473.052260:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658473.052986:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3649:x1875544025210752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8914us (9232us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788658473.052997:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788658473.053414:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658473.053426:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3648:x1875544025211008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788658473.053459:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1788658473.053491:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9cc327, atime: 0x6a9cc327, ctime: 0x6a9cc327, blocks: 0x8 00010000:00010000:1.0:1788658473.053498:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ac851b/0x48e67cc629c6f20f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.053511:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788658473.053515:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658473.053522:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094ac851b/0x48e67cc629c6f20f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.053544:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094ac851b/0x48e67cc629c6f20f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.053565:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ac851b/0x48e67cc629c6f20f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.053573:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094ac851b/0x48e67cc629c6f20f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.053591:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658473.053603:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658473.053608:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094ac851b/0x48e67cc629c6f20f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.053616:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658473.053620:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ac851b/0x48e67cc629c6f20f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.053629:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ac851b/0x48e67cc629c6f20f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.053641:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094ac851b/0x48e67cc629c6f20f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.053648:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094ac851b/0x48e67cc629c6f20f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.053671:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658473.053673:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658473.053675:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658473.054085:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3648:x1875544025211008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 661us (10485us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788658473.054092:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:1.0:1788658473.054131:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1d836fca80/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788658473.054138:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025211008:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788658473.055655:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1eb7400e00/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788658473.055667:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025210752:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788658473.057638:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788658473.057651:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1788658473.058057:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544001020288:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 7672us (7763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658473.058068:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000001:00080000:0.0:1788658473.059173:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1788658473.059187:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788658473.062400:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658473.062504:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001020544 00000100:00100000:2.0:1788658473.062514:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001020544 00000100:00100000:2.0:1788658473.062581:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 137 00000100:00100000:2.0:1788658473.062593:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:11389:x1875544001020544:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658473.062646:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658473.062672:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f1f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c9 expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.062693:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:2.0:1788658473.062698:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658473.062968:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.062983:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.062994:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658473.063118:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2aa13af reply state 000000007bf78979 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.063131:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.063152:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:2.0:1788658473.063154:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788658473.063157:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658473.063257:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:11389:x1875544001020544:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 665us (865us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788658473.063263:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 137 00000100:00100000:0.0:1788658473.067304:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658473.067397:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001020672 00000100:00100000:2.0:1788658473.067407:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001020672 00000100:00100000:2.0:1788658473.067473:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:2.0:1788658473.067485:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544001020672:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788658473.067640:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788658473.067644:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788658472 -> 1788658471 00002000:00010000:2.0:1788658473.067646:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788658471 00002000:00010000:2.0:1788658473.067649:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788658472 -> 1788658471 00002000:00010000:2.0:1788658473.067651:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788658473.067747:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2399:x1875544001020672:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 263us (451us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788658473.067755:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:3.0:1788658473.070405:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658473.070484:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001020928 00000100:00100000:2.0:1788658473.070493:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001020928 00000100:00100000:2.0:1788658473.070546:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 138 00000100:00100000:2.0:1788658473.070564:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:11389:x1875544001020928:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788658473.070637:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.070653:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8bb expref: 17 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.070690:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.070794:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8bb expref: 17 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.070807:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8bb expref: 17 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658473.070821:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875544025211264:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658473.070902:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead8f5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658473.074213:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658473.074300:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001021056 00000100:00100000:3.0:1788658473.074310:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001021056 00010000:00010000:3.0:1788658473.074345:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8bb expref: 18 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658473.074393:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 74 00000100:00100000:3.0:1788658473.074419:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:2396:x1875544001021056:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658473.074433:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658473.074440:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8bb expref: 18 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.074452:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8bb expref: 18 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.074474:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:3.0:1788658473.074480:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.074490:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.074498:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.074516:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658473.074581:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:2396:x1875544001021056:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 164us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658473.074588:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 74 00010000:00010000:2.0:1788658473.075025:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f1d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8bb expref: 17 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658473.075043:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875544025211264:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658473.075062:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.075071:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.075077:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.075113:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.075121:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.075136:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.075141:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658473.075145:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.075153:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.075162:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:2.0:1788658473.075165:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788658473.075169:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.075174:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f21d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658473.075233:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:11389:x1875544001020928:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 Request processed in 4671us (4837us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788658473.075242:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 138 00000100:00100000:0.0:1788658473.079309:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658473.079419:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001021184 00000100:00100000:1.0:1788658473.079428:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001021184 00000100:00100000:1.0:1788658473.079594:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:1.0:1788658473.079604:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdc26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2396:x1875544001021184:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788658473.079650:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.079671:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.079680:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658473.079684:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658473.079689:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.079778:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.079792:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 7 pid: 8452 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658473.079808:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1875544025211392:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658473.080200:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8363c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658473.084157:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658473.084261:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1875544025211392:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658473.084289:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658473.084364:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001021312 00000100:00100000:3.0:1788658473.084371:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001021312 00010000:00010000:3.0:1788658473.084420:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 8 pid: 8452 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658473.084500:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 75 00000100:00100000:3.0:1788658473.084511:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2397:x1875544001021312:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658473.084542:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658473.084575:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 8 pid: 8452 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.084588:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 8 pid: 8452 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.084611:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6f201 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8d7 expref: 8 pid: 8452 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.084628:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658473.084632:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658473.084637:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.084646:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.084674:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658473.084755:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001021312:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 246us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658473.084762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 75 00010000:00010000:0.0:1788658473.084816:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.084826:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.084856:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.084865:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.084874:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.084884:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658473.084889:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.084910:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.084925:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.084932:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6f224 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658473.084976:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdc26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544001021184:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 5374us (5678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658473.084984:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:2.0:1788658473.092982:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658473.093058:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001021568 00000100:00100000:0.0:1788658473.093068:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001021568 00000100:00100000:0.0:1788658473.093127:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00100000:0.0:1788658473.093137:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:11389:x1875544001021568:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788658473.093217:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.093235:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc883 expref: 16 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.093246:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.093280:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc883 expref: 16 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.093308:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc883 expref: 16 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658473.093323:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025211520:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658473.093406:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658473.097172:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658473.097355:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025211520:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658473.097393:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658473.098152:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001021696 00000100:00100000:2.0:1788658473.098160:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001021696 00010000:00010000:2.0:1788658473.098196:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc883 expref: 17 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658473.098238:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:2.0:1788658473.098247:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:2396:x1875544001021696:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658473.098277:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658473.098284:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc883 expref: 17 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.098297:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc883 expref: 17 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.098318:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f11a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc883 expref: 17 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.098335:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658473.098341:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6f17c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8a6 expref: 16 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.098352:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.098360:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.098367:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.098404:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658473.098689:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:2396:x1875544001021696:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 442us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658473.098698:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 76 00010000:00010000:2.0:1788658473.099042:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.099062:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.099228:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.099240:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c2 expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.099250:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.099276:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c2 expref: 16 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.099292:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c2 expref: 16 pid: 6536 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658473.099305:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d38380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025211648:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658473.099468:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504840 going to sleep for 11 seconds 00000100:00100000:0.0:1788658473.106364:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658473.106434:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001021824 00000100:00100000:3.0:1788658473.106453:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001021824 00010000:00010000:3.0:1788658473.106494:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1e5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c2 expref: 17 pid: 6536 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658473.106562:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:3.0:1788658473.106572:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:2397:x1875544001021824:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658473.106587:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658473.106594:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1e5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c2 expref: 17 pid: 6536 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.106615:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c2 expref: 17 pid: 6536 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.106637:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:3.0:1788658473.106643:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.106653:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.106660:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.106681:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658473.106775:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:2397:x1875544001021824:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 204us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658473.106782:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 77 00010000:00010000:2.0:1788658473.113885:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f1e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8c2 expref: 16 pid: 6536 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658473.113919:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d38380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025211648:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658473.113945:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.114040:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658473.114048:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658473.114167:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788658473.115997:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788658473.116047:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788658473.116131:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875544025211776:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788658473.116220:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658473.116296:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658473.118969:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025211776 00000100:00100000:2.0:1788658473.118999:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025211776 00000100:00100000:0.0:1788658473.121690:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788658473.121718:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6537:x1875544025211776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788658473.121883:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6537:x1875544025211776:12345-0@lo:1000:mdt00_001.0 Request processed in 181us (5679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658473.121906:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788658473.122123:0:6537:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788658473.122131:0:6537:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1788658473.122148:0:6537:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1eb7403800, transno 4294967310 00000100:00100000:3.0:1788658473.122168:0:6537:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a1eb7400e00 x1875544025210752/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788658489 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658473.122188:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875544025211776:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788658473.122352:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1788658473.122421:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875544025211904:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788658473.122750:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658473.122788:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658473.124673:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025211904 00000100:00100000:0.0:1788658473.124689:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025211904 00000100:00100000:0.0:1788658473.124768:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788658473.124779:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6537:x1875544025211904:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788658473.124969:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6537:x1875544025211904:12345-0@lo:1000:mdt00_001.0 Request processed in 192us (2218us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788658473.124978:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788658473.125012:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875544025211904:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788658473.125077:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125088:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125097:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125103:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658473.125108:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125115:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125130:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:2.0:1788658473.125133:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658473.125136:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125141:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f232 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125165:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125309:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125318:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125343:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658473.125346:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125351:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125359:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658473.125362:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658473.125368:0:6537:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6f17c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8a6 expref: 19 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125379:0:6537:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6f17c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8a6 expref: 19 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125387:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6f17c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8a6 expref: 19 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.125414:0:6537:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6f17c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8a6 expref: 19 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658473.125424:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d38380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025212032:192.168.202.53@tcp:105: 00000100:00100000:2.0:1788658473.125486:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658473.135369:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d38380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025212032:192.168.202.53@tcp:105: 00010000:00010000:2.0:1788658473.135402:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135436:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f175 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135471:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f239 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135487:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f239 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135497:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f239 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135508:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f239 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135515:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f239 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135520:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f239 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135526:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658473.135530:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f239 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135537:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f239 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135565:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658473.135568:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658473.135573:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f239 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135585:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f239 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135597:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135604:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135610:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135615:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658473.135619:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135626:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135634:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658473.135637:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788658473.135640:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.135646:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f22b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658473.135677:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658473.135872:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11389:x1875544001021568:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 42735us (42899us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788658473.135882:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 139 00000020:00080000:3.0:1788658473.135888:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788658473.135914:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658473.135920:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658473.136264:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788658473.136270:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788658473.136692:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001021952 00000100:00100000:0.0:1788658473.136720:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001021952 00000100:00100000:0.0:1788658473.136771:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:0.0:1788658473.136782:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11388:x1875544001021952:12345-192.168.202.53@tcp:49:lfs.0 00000100:00100000:0.0:1788658473.136905:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11388:x1875544001021952:12345-192.168.202.53@tcp:49:lfs.0 Request processed in 124us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658473.136913:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:3.0:1788658473.143024:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658473.143648:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001022208 00000100:00100000:2.0:1788658473.143658:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001022208 00000100:00100000:2.0:1788658473.143730:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 140 00000100:00100000:2.0:1788658473.143740:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11388:x1875544001022208:12345-192.168.202.53@tcp:58:lfs.0 00000040:00080000:2.0:1788658473.143902:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788658473.143975:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11388:x1875544001022208:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 235us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658473.143982:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 140 00000100:00100000:1.0:1788658473.144256:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658473.149744:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001022464 00000100:00100000:3.0:1788658473.149758:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001022464 00000100:00100000:3.0:1788658473.149827:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:3.0:1788658473.149837:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:11389:x1875544001022464:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788658473.150082:0:13563:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788658473.150112:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1788658473.150143:0:13563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150158:0:13563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150169:0:13563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150177:0:13563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150197:0:13563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150203:0:13563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150222:0:13563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658473.150271:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658473.150277:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150283:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658473.150287:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150296:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150308:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:3.0:1788658473.150311:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788658473.150315:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150321:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f240 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.150336:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658473.150338:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658473.150340:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658473.150419:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:11389:x1875544001022464:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 582us (6162us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788658473.150436:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000020:00080000:3.0:1788658473.150441:0:13563:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788658473.151887:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658473.151922:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658473.152017:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658473.152048:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658473.152072:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658473.155263:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001022592 00000100:00100000:1.0:1788658473.155283:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001022592 00000100:00100000:1.0:1788658473.156506:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 384 00000100:00100000:1.0:1788658473.156519:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2396:x1875544001022592:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658473.156620:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2396:x1875544001022592:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 103us (4602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658473.156627:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 384 00000100:00100000:1.0:1788658473.156669:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001022848 00000100:00100000:1.0:1788658473.156675:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001022848 00000100:00100000:1.0:1788658473.156743:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:1.0:1788658473.156751:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544001022848:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658473.158222:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001022720 00000100:00100000:0.0:1788658473.158231:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001022720 00000100:00100000:0.0:1788658473.158272:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001022976 00000100:00100000:0.0:1788658473.158274:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001022976 00000100:00100000:1.0:1788658473.158298:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544001022848:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 1544us (6245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658473.158303:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001023104 00000100:00100000:0.0:1788658473.158306:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001023104 00000100:00100000:1.0:1788658473.158310:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:0.0:1788658473.158321:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 308 00000100:00100000:0.0:1788658473.158328:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544001022720:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658473.158359:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544001022720:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 33us (6478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658473.158363:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 308 00000100:00100000:0.0:1788658473.158384:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 309 00000100:00100000:0.0:1788658473.158388:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544001022976:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658473.158405:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544001022976:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 17us (6483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658473.158409:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 309 00000100:00100000:0.0:1788658473.158416:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 310 00000100:00100000:0.0:1788658473.158419:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544001023104:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658473.158431:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544001023104:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 11us (6359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658473.158435:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 310 00000100:00080000:1.0:1788658473.158477:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658473.158483:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658473.158486:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658473.169143:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658473.169233:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001023232 00000100:00100000:3.0:1788658473.169243:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001023232 00000100:00100000:3.0:1788658473.169305:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 141 00000100:00100000:3.0:1788658473.169315:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:11391:x1875544001023232:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658473.169340:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658473.169361:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f247 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8de expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169437:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f24e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169452:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f24e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169464:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f24e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169479:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f255 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169485:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f255 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169493:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f255 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169575:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169602:0:7958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc89f expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169612:0:7958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169642:0:7958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc89f expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658473.169655:0:7958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc89f expref: 22 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658473.169668:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025212160:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658473.170219:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8375dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658473.181979:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658473.182052:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001023488 00000100:00100000:0.0:1788658473.182062:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001023488 00000100:00100000:0.0:1788658473.182126:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:0.0:1788658473.182138:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:6169:x1875544001023488:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788658473.182371:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:6169:x1875544001023488:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 236us (400us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788658473.182390:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:1.0:1788658473.182759:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025212160:192.168.202.53@tcp:104: 00010000:00010000:1.0:1788658473.182787:0:7958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658473.185466:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658473.185687:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001023616 00000100:00100000:2.0:1788658473.185698:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001023616 00010000:00010000:2.0:1788658473.185779:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc89f expref: 24 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658473.185815:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:2.0:1788658473.185836:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:2397:x1875544001023616:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658473.185852:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658473.185859:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc89f expref: 24 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.185874:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc89f expref: 24 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.185915:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f167 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc89f expref: 24 pid: 6537 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.185935:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:2.0:1788658473.185941:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.185951:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.185959:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658473.185993:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658473.186044:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:2397:x1875544001023616:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 219us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658473.186052:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 78 00010000:00010000:1.0:1788658473.186255:0:7958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186266:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658473.186318:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788658473.186322:0:7958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658473.186339:0:7958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186353:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186363:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f24e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186369:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f24e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186375:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f24e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186381:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658473.186385:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f24e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186400:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f24e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186410:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:1.0:1788658473.186413:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658473.186417:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f24e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186424:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f24e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186448:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f255 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186456:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f255 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186462:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f255 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186467:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80030200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658473.186470:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f255 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186477:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f255 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186485:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8a1e90e7e100) 00010000:00010000:1.0:1788658473.186487:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658473.186490:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f255 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186504:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030200/0x48e67cc629c6f255 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186550:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f247 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8de expref: 23 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186566:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8de expref: 22 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658473.186573:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:1.0:1788658473.186576:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788658473.186578:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031200, rc 0) 00000100:00100000:1.0:1788658473.186615:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11391:x1875544001023232:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 17302us (17483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658473.186623:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 141 00010000:00010000:3.0:1788658473.406809:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658473.808320:0:14276:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658473.808327:0:14276:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658473.808417:0:14276:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788658473.808426:0:14276:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788658474.174958:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658474.174967:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658474.175012:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788658474.175024:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788658474.175154:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d3bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025212288:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788658474.175282:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658474.181013:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d3bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025212288:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788658474.188852:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658474.189176:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001023744 00000100:00100000:3.0:1788658474.189188:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001023744 00000100:00100000:3.0:1788658474.189249:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 142 00000100:00100000:3.0:1788658474.189260:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11403:x1875544001023744:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788658474.189297:0:6537:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788658474.189434:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11403:x1875544001023744:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 167us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658474.189442:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 142 00000100:00100000:2.0:1788658474.199059:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658474.199776:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001024000 00000100:00100000:0.0:1788658474.199788:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001024000 00000100:00100000:0.0:1788658474.199850:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 143 00000100:00100000:0.0:1788658474.199860:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:11403:x1875544001024000:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658474.199883:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658474.199905:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f263 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8e5 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658474.200045:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f26a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658474.200059:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f26a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658474.200073:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f26a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658474.200083:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788658474.200196:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f263 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8e5 expref: 25 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658474.200217:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f26a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8e5 expref: 24 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658474.200226:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:0.0:1788658474.200229:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658474.200232:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670c00, rc 0) 00000100:00100000:0.0:1788658474.200301:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:11403:x1875544001024000:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 442us (1252us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788658474.200309:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 143 00000100:00100000:0.0:1788658474.214892:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658474.214937:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658474.215072:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001024128 00000100:00100000:3.0:1788658474.215096:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001024128 00000100:00100000:3.0:1788658474.215162:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:3.0:1788658474.215173:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:2397:x1875544001024128:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658474.215188:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658474.215214:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f26a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8e5 expref: 24 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658474.215235:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658474.215240:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658474.215298:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:2397:x1875544001024128:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 126us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658474.215307:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:1.0:1788658474.216569:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001024384 00000100:00100000:1.0:1788658474.216580:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001024384 00000100:00100000:1.0:1788658474.216634:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 144 00000100:00100000:1.0:1788658474.216643:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:11403:x1875544001024384:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788658474.216757:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f278 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658474.216773:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f278 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658474.216807:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f278 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658474.216961:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f278 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658474.216968:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f278 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658474.216974:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f278 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658474.216980:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658474.216984:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f278 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658474.216990:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f278 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658474.217001:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:1.0:1788658474.217004:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788658474.217008:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f278 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658474.217015:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f278 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658474.217130:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:11403:x1875544001024384:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 487us (2192us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788658474.217139:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 144 00000040:00080000:2.0:1788658474.217390:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658474.217395:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658474.217908:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788658474.217918:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788658474.227259:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658474.227372:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001024640 00000100:00100000:2.0:1788658474.227382:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001024640 00000100:00100000:2.0:1788658474.227447:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:2.0:1788658474.227458:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:11403:x1875544001024640:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788658474.227680:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11403:x1875544001024640:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 223us (430us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788658474.227689:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:1.0:1788658474.431059:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025212416:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658474.431179:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658474.431191:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658474.431680:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025212416 00000100:00100000:3.0:1788658474.431691:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025212416 00000100:00100000:3.0:1788658474.431770:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788658474.431789:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025212416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658474.431825:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658474.431904:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025212416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658474.431912:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788658474.432050:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025212416:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788658475.328573:0:14328:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658475.328581:0:14328:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658475.328621:0:14328:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788658475.328627:0:14328:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788658475.456035:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658475.465499:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658475.465552:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001024896 00000100:00100000:3.0:1788658475.466489:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001024896 00000100:00100000:3.0:1788658475.468734:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 145 00000100:00100000:3.0:1788658475.468754:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:11424:x1875544001024896:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658475.468782:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658475.468835:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f27f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8ec expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658475.471646:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f286 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658475.471669:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f286 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658475.471684:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f286 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658475.471699:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788658475.471844:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f27f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8ec expref: 28 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658475.471864:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f286 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8ec expref: 27 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658475.471872:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658475.471875:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788658475.471878:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80030400, rc 0) 00000100:00100000:3.0:1788658475.471969:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:11424:x1875544001024896:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 3222us (7581us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788658475.471978:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 145 00000100:00080000:3.0:1788658475.472019:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658475.480507:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658475.480688:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001025024 00000100:00100000:0.0:1788658475.480698:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001025024 00000100:00100000:0.0:1788658475.480778:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 146 00000100:00100000:0.0:1788658475.482001:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:11424:x1875544001025024:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:0.0:1788658475.482242:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f294 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658475.482260:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658475.482994:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658475.483034:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f294 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658475.483040:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f294 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658475.483057:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658475.483064:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658475.483069:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f294 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658475.483077:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f294 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658475.483089:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:0.0:1788658475.483100:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658475.483106:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f294 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658475.483113:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f294 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658475.483609:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:11424:x1875544001025024:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 1615us (3105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658475.483619:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 146 00000100:00100000:0.0:1788658475.563190:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658475.566947:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001025152 00000100:00100000:3.0:1788658475.566961:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001025152 00000100:00100000:2.0:1788658475.567151:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00080000:3.0:1788658475.567160:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658475.567164:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544001025152:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:2.0:1788658475.567184:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658475.567207:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c6f29b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8f3 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658475.567234:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9cc327, atime: 0x6a9cc327, ctime: 0x6a9cc327, blocks: 0x8 00010000:00010000:2.0:1788658475.567255:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=392s v=(0 0) 00010000:00010000:2.0:1788658475.567279:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658475.567289:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c6f29b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8f3 expref: 7 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658475.567310:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c6f29b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8f3 expref: 7 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658475.567338:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1800, rc 0) 00000100:00100000:2.0:1788658475.567400:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2396:x1875544001025152:12345-192.168.202.53@tcp:101:cat.0 Request processed in 240us (4222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658475.567408:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:3.0:1788658475.571808:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658475.573038:0:8459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001025280 00000100:00100000:0.0:1788658475.573049:0:8459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001025280 00002000:00100000:0.0:1788658475.573107:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8a1eb7403800 x1875544001025280/t0(0) o3->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:66/0 lens 488/0 e 0 to 0 dl 1788658486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658475.573119:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1eb7403800 with x1875544001025280 ext(0->4095) 00002000:00010000:0.0:1788658475.573126:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1eb7403800 00000100:00100000:0.0:1788658475.573239:0:8459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:0.0:1788658475.573250:0:8459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001025280:12345-192.168.202.53@tcp:3:cat.0 00000100:00100000:0.0:1788658475.573459:0:8459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001025280:12345-192.168.202.53@tcp:3:cat.0 Request processed in 210us (1660us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788658475.573466:0:8459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00002000:00100000:0.0:1788658475.573474:0:8459:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8a1eb7403800 x1875544001025280/t0(0) o3->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:66/0 lens 488/4536 e 0 to 0 dl 1788658486 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788658475.573482:0:8459:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1eb7403800 with x1875544001025280 ext(0->4095) 00002000:00010000:0.0:1788658475.573485:0:8459:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1eb7403800 00000100:00100000:1.0:1788658475.967339:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658475.967365:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025212544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658475.967434:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658475.967576:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025212800:0@lo:400:kworker.0 00000100:00100000:3.0:1788658475.967608:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658475.967633:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025213184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658475.967654:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658475.967677:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025213824:0@lo:400:kworker.0 00000100:00100000:3.0:1788658475.967718:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658475.967719:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025212800 00000100:00100000:3.0:1788658475.967736:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788658475.967740:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025212800 00000100:00100000:3.0:1788658475.967741:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025212928:0@lo:400:kworker.0 00000100:00100000:3.0:1788658475.967763:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658475.967777:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025213440:0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.967784:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788658475.967792:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025212800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658475.967795:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658475.967814:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025213952:0@lo:400:kworker.0 00000100:00100000:3.0:1788658475.967836:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658475.967848:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025212800:12345-0@lo:400:kworker.0 Request processed in 57us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658475.967854:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788658475.967868:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025212800:0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.967870:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025213440 00000100:00100000:0.0:1788658475.967872:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025213440 00000100:00100000:3.0:1788658475.967895:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025212544 00000100:00100000:0.0:1788658475.967897:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025213952 00000100:00100000:3.0:1788658475.967898:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025212544 00000100:00100000:0.0:1788658475.967898:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025213952 00000100:00100000:0.0:1788658475.967911:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788658475.967916:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025213440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658475.967917:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025213184 00000100:00100000:3.0:1788658475.967919:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025213184 00000100:00100000:3.0:1788658475.967932:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788658475.967937:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875544025212544:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658475.967945:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025213440:12345-0@lo:400:kworker.0 Request processed in 30us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658475.967951:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00002000:00000024:3.0:1788658475.967958:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788658475.967961:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788658475.967965:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025213952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.967985:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025213952:12345-0@lo:400:kworker.0 Request processed in 19us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658475.967990:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788658475.968007:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025213824 00000100:00100000:0.0:1788658475.968011:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025213824 00000100:00100000:0.0:1788658475.968032:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788658475.968039:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025213824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.968068:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025213824:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658475.968073:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788658475.968098:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788658475.968102:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658475.968104:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658475.968122:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83468e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025213440:0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.968133:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025213952:0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.968140:0:3647:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788658475.968145:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1788658475.968159:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1eb2251c00, transno 4294967302 00000004:00080000:0.0:1788658475.968167:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788658475.968177:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1d836fca80, transno 4294967305 00000100:00100000:0.0:1788658475.968182:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025213824:0@lo:400:kworker.0 00000100:00100000:1.0:1788658475.968210:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025212928 00000100:00100000:1.0:1788658475.968214:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025212928 00000100:00100000:0.0:1788658475.968233:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025212672:0@lo:400:kworker.0 00000100:00100000:1.0:1788658475.968251:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788658475.968257:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025212928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.968261:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658475.968282:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025213312:0@lo:400:kworker.0 00000100:00100000:1.0:1788658475.968291:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025212928:12345-0@lo:400:kworker.0 Request processed in 35us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658475.968298:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788658475.968301:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658475.968315:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025213696:0@lo:400:kworker.0 00000100:00100000:3.0:1788658475.968323:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875544025212544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658475.968331:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788658475.968334:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658475.968348:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025214208:0@lo:400:kworker.0 00000100:00100000:3.0:1788658475.968351:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788658475.968356:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025213184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788658475.968365:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788658475.968366:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658475.968388:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025213184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658475.968390:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025212544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658475.968394:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788658475.968402:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788658475.968408:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025213056:0@lo:400:kworker.0 00000100:00100000:3.0:1788658475.968423:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025212672 00000100:00100000:3.0:1788658475.968426:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025212672 00000100:00100000:0.0:1788658475.968428:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658475.968443:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8346aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025213568:0@lo:400:kworker.0 00000100:00100000:3.0:1788658475.968447:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788658475.968453:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025212672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.968473:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658475.968476:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025212672:12345-0@lo:400:kworker.0 Request processed in 24us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658475.968482:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788658475.968485:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025214080:0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.968504:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658475.968521:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025212672:0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.968540:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025213696 00000100:00100000:0.0:1788658475.968543:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025213696 00000100:00100000:0.0:1788658475.968566:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025214208 00000100:00100000:0.0:1788658475.968569:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025214208 00000100:00100000:0.0:1788658475.968582:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788658475.968587:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025213696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.968620:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025213696:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658475.970497:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025213312 00000100:00100000:1.0:1788658475.970517:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025213312 00000100:00100000:1.0:1788658475.970652:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788658475.970664:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025213312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658475.970912:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025213312:12345-0@lo:400:kworker.0 Request processed in 250us (2608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658475.970920:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788658475.972104:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025213056 00000100:00100000:2.0:1788658475.972908:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788658475.972926:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025214208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658475.973014:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025214208:12345-0@lo:400:kworker.0 Request processed in 94us (4645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658475.973022:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788658475.973096:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025212928:0@lo:400:kworker.0 00000100:00100000:2.0:1788658475.973120:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025213184:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788658475.973162:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658475.973189:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025213312:0@lo:400:kworker.0 00000100:00100000:2.0:1788658475.973202:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025213696:0@lo:400:kworker.0 00000100:00100000:2.0:1788658475.973210:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025214208:0@lo:400:kworker.0 00000100:00100000:2.0:1788658475.973279:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025213568 00000100:00100000:2.0:1788658475.973285:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025213568 00000100:00100000:2.0:1788658475.973330:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025214080 00000100:00100000:2.0:1788658475.973333:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025214080 00000100:00100000:2.0:1788658475.973360:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788658475.973367:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025213568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658475.973406:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83468e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025213568:12345-0@lo:400:kworker.0 Request processed in 39us (4932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658475.973428:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788658475.973442:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788658475.973450:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025214080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658475.973482:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025214080:12345-0@lo:400:kworker.0 Request processed in 33us (4977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658475.973487:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00080000:2.0:1788658475.973502:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788658475.973524:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d8346aa00 x1875544025213568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658475.973535:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8346aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025213568:0@lo:400:kworker.0 00010000:00080000:2.0:1788658475.973547:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83c21880 x1875544025214080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658475.973556:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025214080:0@lo:400:kworker.0 00000100:00100000:1.0:1788658475.973575:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025213056 00000100:00100000:2.0:1788658475.973657:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788658475.973667:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025213056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658475.973724:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025213056:12345-0@lo:400:kworker.0 Request processed in 59us (5293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658475.973732:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788658475.973770:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025213056:0@lo:400:kworker.0 00000100:00100000:0.0:1788658475.980994:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788658476.479966:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658476.479989:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025214336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658476.480069:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658476.482332:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658476.482352:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025214464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658476.482416:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658476.482560:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025214336 00000100:00100000:2.0:1788658476.482570:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025214336 00000100:00100000:2.0:1788658476.482951:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025214464 00000100:00100000:2.0:1788658476.482956:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025214464 00000100:00100000:2.0:1788658476.482974:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788658476.482996:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025214336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658476.483026:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658476.483080:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025214336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658476.483087:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788658476.483101:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788658476.483106:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025214464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788658476.483115:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658476.483147:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025214464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658476.483153:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788658476.483284:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025214464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658476.483447:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025214336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788658476.489256:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658476.992370:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658476.992558:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025214592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658476.992653:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658476.992954:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025214592 00000100:00100000:3.0:1788658476.992965:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025214592 00000100:00100000:3.0:1788658476.993097:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788658476.993119:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025214592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658476.993161:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788658476.993224:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025214592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658476.993231:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788658476.993358:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025214592:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788658477.311904:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658477.311918:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658477.311942:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788658477.311956:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788658477.503638:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658477.823881:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788658478.269343:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658478.269389:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658478.269422:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658478.269448:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658478.269479:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658478.269499:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658478.269535:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658478.269564:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001025920 00000100:00100000:2.0:1788658478.269573:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001025920 00000100:00100000:2.0:1788658478.269628:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001025792 00000100:00100000:2.0:1788658478.269631:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001025792 00000100:00100000:2.0:1788658478.269657:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 112 00000100:00100000:2.0:1788658478.269667:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2398:x1875544001025920:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658478.269766:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2398:x1875544001025920:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 99us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658478.269774:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 112 00000100:00100000:2.0:1788658478.269791:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:2.0:1788658478.269798:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001025792:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658478.269822:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001025792:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658478.269828:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 113 00000100:00100000:2.0:1788658478.269847:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001025664 00000100:00100000:2.0:1788658478.269850:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001025664 00000100:00100000:2.0:1788658478.269874:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001026176 00000100:00100000:2.0:1788658478.269877:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001026176 00000100:00100000:2.0:1788658478.269886:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001025536 00000100:00100000:2.0:1788658478.269888:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001025536 00000100:00100000:2.0:1788658478.269899:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001026048 00000100:00100000:2.0:1788658478.269901:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001026048 00000100:00100000:2.0:1788658478.269914:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 317 00000100:00100000:2.0:1788658478.269919:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001025664:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658478.269948:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001025664:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658478.269977:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 317 00000100:00100000:2.0:1788658478.269990:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 318 00000100:00100000:2.0:1788658478.269997:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001026176:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658478.270021:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001026176:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658478.270027:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 318 00000100:00100000:2.0:1788658478.270037:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 319 00000100:00100000:2.0:1788658478.270042:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:2398:x1875544001025536:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658478.270069:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:2398:x1875544001025536:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658478.270075:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 319 00000100:00100000:2.0:1788658478.270086:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 320 00000100:00100000:2.0:1788658478.270092:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001026048:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658478.270113:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001026048:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 21us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658478.270119:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 320 00000100:00080000:2.0:1788658478.270141:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658478.270145:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658478.270148:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658478.270149:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658478.270306:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001025408 00000100:00100000:1.0:1788658478.270315:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001025408 00000100:00100000:1.0:1788658478.270352:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 386 00000100:00100000:1.0:1788658478.270360:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544001025408:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658478.270385:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544001025408:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 29us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658478.270391:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 386 00010000:00010000:3.0:1788658478.534278:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788658478.536219:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788658478.536267:0:6515:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1d8375dd80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788658478.536274:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d835ff000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1d8375da80 00000020:00080000:3.0:1788658478.536278:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d835ff200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1d824dea00 00010000:00010000:0.0:1788658478.536478:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658478.536494:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658478.536503:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658478.536510:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658478.536516:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658478.536534:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658478.536555:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8a1eb35f0300) 00010000:00010000:0.0:1788658478.536559:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658478.536565:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658478.536572:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f216 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658478.536678:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788658478.536687:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000020:00080000:3.0:1788658478.537244:0:6515:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788658478.537262:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788658478.537447:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788658479.550931:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658479.551627:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025214720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658479.551878:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658479.552044:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025214720 00000100:00100000:3.0:1788658479.552056:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025214720 00000100:00100000:3.0:1788658479.552134:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788658479.552145:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025214720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658479.552189:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658479.552255:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025214720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658479.552263:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788658479.552489:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025214720:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788658480.576944:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658481.094372:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658481.094396:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025214848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658481.094463:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658481.094863:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025215360:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.094899:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658481.095074:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025215872:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.095107:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658481.095136:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025216384:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.095158:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658481.095176:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788658481.095182:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025214976:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.095210:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658481.095231:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025215488:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.095253:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658481.095271:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025216000:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.095291:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658481.095317:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025214976 00000100:00100000:1.0:1788658481.095325:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025214976 00000100:00100000:1.0:1788658481.095373:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788658481.095383:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025214976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.095453:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025214976:12345-0@lo:400:kworker.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658481.095460:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788658481.095667:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025215104:0@lo:400:kworker.0 00000100:00100000:0.0:1788658481.095699:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658481.095738:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025215616:0@lo:400:kworker.0 00000100:00100000:0.0:1788658481.095759:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658481.095772:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025216128:0@lo:400:kworker.0 00000100:00100000:0.0:1788658481.095792:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658481.095811:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788658481.095818:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025215232:0@lo:400:kworker.0 00000100:00100000:0.0:1788658481.095838:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658481.095883:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025215488 00000100:00100000:1.0:1788658481.095888:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025215488 00000100:00100000:1.0:1788658481.095987:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788658481.095996:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025215488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.096105:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025215488:12345-0@lo:400:kworker.0 Request processed in 111us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658481.096112:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788658481.096196:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025214848 00000100:00100000:2.0:1788658481.096201:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025214848 00000100:00100000:2.0:1788658481.096237:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788658481.096243:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025214848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658481.096268:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788658481.096304:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025214848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.096310:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788658481.096334:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025215360 00000100:00100000:2.0:1788658481.096337:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025215360 00000100:00100000:2.0:1788658481.096361:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025215104 00000100:00100000:2.0:1788658481.096365:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025215104 00000100:00100000:2.0:1788658481.096375:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025215616 00000100:00100000:2.0:1788658481.096377:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025215616 00000100:00100000:2.0:1788658481.096388:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025216128 00000100:00100000:2.0:1788658481.096390:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025216128 00000100:00100000:2.0:1788658481.096404:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788658481.096410:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025215360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658481.096440:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025215360:12345-0@lo:400:kworker.0 Request processed in 30us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.096446:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788658481.096456:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788658481.096461:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025215104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658481.096483:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025215104:12345-0@lo:400:kworker.0 Request processed in 22us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.096488:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788658481.096512:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788658481.096529:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025215616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658481.096565:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025215616:12345-0@lo:400:kworker.0 Request processed in 38us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.096572:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788658481.096583:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788658481.096589:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025216128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658481.096612:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025216128:12345-0@lo:400:kworker.0 Request processed in 23us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.096618:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788658481.096646:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025215872 00000100:00100000:2.0:1788658481.096650:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025215872 00000100:00100000:2.0:1788658481.096673:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025216384 00000100:00100000:2.0:1788658481.096676:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025216384 00000100:00100000:2.0:1788658481.096690:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025216000 00000100:00100000:2.0:1788658481.096692:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025216000 00000100:00100000:2.0:1788658481.096720:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788658481.096726:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025215872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658481.096755:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025215872:12345-0@lo:400:kworker.0 Request processed in 28us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.096761:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788658481.096770:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788658481.096776:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025216384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658481.096800:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025216384:12345-0@lo:400:kworker.0 Request processed in 25us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.096806:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788658481.096815:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788658481.096821:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025216000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658481.096853:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025216000:12345-0@lo:400:kworker.0 Request processed in 32us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.096860:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788658481.097248:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025215744:0@lo:400:kworker.0 00000100:00100000:0.0:1788658481.097279:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658481.097296:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025216256:0@lo:400:kworker.0 00000100:00100000:0.0:1788658481.097318:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658481.097358:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025215104:0@lo:400:kworker.0 00000100:00100000:0.0:1788658481.097368:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025215616:0@lo:400:kworker.0 00000100:00100000:0.0:1788658481.097377:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025216128:0@lo:400:kworker.0 00000100:00100000:0.0:1788658481.097412:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025215744 00000100:00100000:0.0:1788658481.097415:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025215744 00000100:00100000:0.0:1788658481.097444:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025216256 00000100:00100000:0.0:1788658481.097447:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025216256 00000100:00100000:0.0:1788658481.097460:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788658481.097465:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025215744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.097628:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025215232 00000100:00100000:1.0:1788658481.097643:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025215232 00000100:00100000:1.0:1788658481.097664:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788658481.097672:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025215232:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788658481.098164:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658481.098170:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658481.098172:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658481.098175:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658481.098193:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788658481.098202:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025216256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.099234:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025215232:12345-0@lo:400:kworker.0 Request processed in 1558us (3389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658481.099246:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788658481.099320:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025214976:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.099336:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025215488:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.099351:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025216000:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.099364:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025215360:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.099377:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025215872:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.099389:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025216384:0@lo:400:kworker.0 00000100:00100000:1.0:1788658481.099430:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658481.099439:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025216512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658481.099476:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658481.099541:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025216512 00000100:00100000:1.0:1788658481.099548:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025216512 00000100:00100000:1.0:1788658481.099583:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788658481.099591:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025216512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658481.099612:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788658481.099663:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025216512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658481.099670:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788658481.100509:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025216512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658481.100519:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025215744:12345-0@lo:400:kworker.0 Request processed in 3045us (3230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658481.100749:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788658481.100817:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788658481.100823:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1eb7400e00, transno 4294967311 00000004:00080000:0.0:1788658481.100841:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:0.0:1788658481.100871:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025214848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658481.103746:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025215232:0@lo:400:kworker.0 00010000:00080000:1.0:1788658481.103775:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d836ff100 x1875544025215744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658481.103795:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025215744:0@lo:400:kworker.0 00000100:00100000:2.0:1788658481.106761:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025216256:12345-0@lo:400:kworker.0 Request processed in 8545us (9427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658481.106780:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00080000:1.0:1788658481.106909:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d836fc380 x1875544025216256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658481.106931:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025216256:0@lo:400:kworker.0 00000100:00100000:2.0:1788658481.572973:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658481.579265:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001026304 00000100:00100000:1.0:1788658481.579281:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001026304 00000100:00100000:1.0:1788658481.579391:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 147 00000100:00100000:1.0:1788658481.579403:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:11077:x1875544001026304:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788658481.579534:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:11077:x1875544001026304:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 Request processed in 133us (6571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658481.579557:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 147 00000100:00080000:2.0:1788658481.580629:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658481.582517:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658481.582596:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001026432 00000100:00100000:0.0:1788658481.582607:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001026432 00000100:00100000:0.0:1788658481.582685:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 148 00000100:00100000:0.0:1788658481.582697:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:11077:x1875544001026432:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788658481.582865:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:11077:x1875544001026432:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 Request processed in 170us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658481.582873:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 148 00000100:00080000:2.0:1788658481.583071:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658481.589294:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658481.589569:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001026688 00000100:00100000:2.0:1788658481.589589:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001026688 00000100:00100000:2.0:1788658481.589653:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:2.0:1788658481.589664:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:11077:x1875544001026688:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788658481.589952:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:11077:x1875544001026688:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 289us (668us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788658481.589960:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00010000:00010000:3.0:1788658481.598957:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658481.599628:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025216640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658481.599727:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658481.599774:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025216640 00000100:00100000:0.0:1788658481.599782:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025216640 00000100:00100000:0.0:1788658481.599844:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788658481.599863:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025216640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658481.599891:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658481.599933:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025216640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658481.599940:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788658481.600444:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025216768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658481.600487:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025216640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658481.600493:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658481.600537:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025216768 00000100:00100000:1.0:1788658481.600543:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025216768 00000100:00100000:1.0:1788658481.600585:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788658481.600592:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025216768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658481.600602:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658481.600630:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025216768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658481.600636:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788658481.600752:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025216768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658481.897281:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658481.897392:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001026816 00000100:00100000:0.0:1788658481.897402:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001026816 00000100:00100000:0.0:1788658481.897481:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 149 00000100:00100000:0.0:1788658481.897492:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+5:11882:x1875544001026816:12345-192.168.202.53@tcp:101:lsof.0 00010000:00010000:0.0:1788658481.897603:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658481.897626:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc8fa expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.897690:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.897738:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.897753:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658481.897806:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788658481.897810:0:7958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658481.897850:0:7958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.897874:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8fa expref: 7 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.897911:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8fa expref: 6 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658481.897919:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:0.0:1788658481.897922:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658481.897926:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670a00, rc 0) 00000100:00080000:2.0:1788658481.898045:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658481.905840:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bab2558f-23d6-4f42-bb42-9568fb514d36+6:11882:x1875544001026816:12345-192.168.202.53@tcp:101:lsof.0 Request processed in 8336us (8690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658481.905854:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 149 00000100:00100000:2.0:1788658482.112464:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658482.112491:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025216896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658482.112574:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658482.112650:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025216896 00000100:00100000:3.0:1788658482.112659:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025216896 00000100:00100000:3.0:1788658482.112736:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788658482.112747:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025216896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658482.112780:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788658482.112831:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025216896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658482.112839:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788658482.112985:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025216896:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658482.622871:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658483.386422:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658483.386472:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658483.386509:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658483.386541:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658483.386561:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658483.386584:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658483.386607:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658483.386632:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001027200 00000100:00100000:0.0:1788658483.386642:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001027200 00000100:00100000:1.0:1788658483.386646:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001027712 00000100:00100000:1.0:1788658483.386653:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001027712 00000100:00100000:2.0:1788658483.386725:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001026944 00000100:00100000:2.0:1788658483.386731:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001026944 00000100:00100000:3.0:1788658483.386779:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001027456 00000100:00100000:3.0:1788658483.386783:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001027456 00000100:00100000:2.0:1788658483.386863:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 388 00000100:00100000:2.0:1788658483.386876:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2396:x1875544001026944:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658483.386960:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2396:x1875544001026944:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 82us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658483.386968:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 388 00000100:00100000:2.0:1788658483.387013:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001027328 00000100:00100000:2.0:1788658483.387018:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001027328 00000100:00100000:0.0:1788658483.387100:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001027072 00000100:00100000:0.0:1788658483.387104:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001027072 00000100:00100000:1.0:1788658483.387105:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001027584 00000100:00100000:1.0:1788658483.387111:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001027584 00000100:00100000:0.0:1788658483.387126:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 327 00000100:00100000:0.0:1788658483.387356:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544001027712:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658483.387402:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2396:x1875544001027712:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 268us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658483.387496:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 328 00000100:00100000:1.0:1788658483.387505:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544001027200:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658483.387535:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544001027200:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 32us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658483.387542:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 328 00000100:00100000:1.0:1788658483.387558:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 329 00000100:00100000:1.0:1788658483.387565:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:2396:x1875544001027072:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658483.387591:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:2396:x1875544001027072:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658483.387611:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 329 00000100:00100000:1.0:1788658483.387624:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 330 00000100:00100000:1.0:1788658483.387630:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2396:x1875544001027584:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658483.387654:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2396:x1875544001027584:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658483.387659:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 330 00000100:00080000:1.0:1788658483.387699:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658483.387723:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788658483.387725:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658483.387727:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658483.389724:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:3.0:1788658483.389738:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544001027456:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658483.389801:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544001027456:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 66us (3290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658483.389807:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:2.0:1788658483.396615:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:2.0:1788658483.396636:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544001027328:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658483.396739:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2396:x1875544001027328:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 110us (10152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658483.396747:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:0.0:1788658483.397051:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 327 00010000:00010000:2.0:1788658483.646985:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658484.671057:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658484.671759:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025217024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658484.671823:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658484.672097:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025217024 00000100:00100000:3.0:1788658484.672105:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025217024 00000100:00100000:3.0:1788658484.672147:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788658484.672156:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025217024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658484.672189:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658484.672243:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025217024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658484.672250:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000001:00080000:0.0:1788658484.673610:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788658484.673627:0:6515:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788658484.673664:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788658484.673676:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788658484.673763:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025217024:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788658485.698690:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658486.208742:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025217152:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.208835:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.208892:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025217664:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.208923:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.208943:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025218176:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.208967:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.208983:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025218688:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209001:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.209027:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788658486.209032:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025217280:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209069:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.209089:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025217792:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209111:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.209126:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025218304:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209163:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.209192:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025217408:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209216:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.209232:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025217920:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209254:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.209269:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025218432:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209292:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.209311:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788658486.209318:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025217536:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209340:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.209352:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025218048:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209374:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.209388:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025218560:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209406:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.209435:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025217152 00000100:00100000:1.0:1788658486.209443:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025217152 00000100:00100000:1.0:1788658486.209498:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788658486.209510:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025217152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209567:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025217152:12345-0@lo:400:kworker.0 Request processed in 59us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.209575:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788658486.209615:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025217280 00000100:00100000:1.0:1788658486.209619:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025217280 00000100:00100000:1.0:1788658486.209639:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025217792 00000100:00100000:1.0:1788658486.209641:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025217792 00000100:00100000:1.0:1788658486.209665:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025218304 00000100:00100000:1.0:1788658486.209674:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025218304 00000100:00100000:1.0:1788658486.209692:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025217920 00000100:00100000:1.0:1788658486.209694:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025217920 00000100:00100000:1.0:1788658486.209732:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025218432 00000100:00100000:1.0:1788658486.209734:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025218432 00000100:00100000:1.0:1788658486.209746:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025217536 00000100:00100000:1.0:1788658486.209748:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025217536 00000100:00100000:1.0:1788658486.209760:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788658486.209766:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025217280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209801:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025217280:12345-0@lo:400:kworker.0 Request processed in 36us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.209808:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788658486.209820:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788658486.209825:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025217792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209849:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025217792:12345-0@lo:400:kworker.0 Request processed in 25us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.209856:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788658486.209866:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788658486.209871:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025218304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209898:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025218304:12345-0@lo:400:kworker.0 Request processed in 27us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.209904:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788658486.209914:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788658486.209920:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025217920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.209949:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025217920:12345-0@lo:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.209955:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788658486.209973:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788658486.209979:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025218432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.210008:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025218432:12345-0@lo:400:kworker.0 Request processed in 29us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.210014:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788658486.210024:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788658486.210030:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025217536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.210067:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025217536:12345-0@lo:400:kworker.0 Request processed in 37us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.210073:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:1.0:1788658486.210107:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658486.210112:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658486.210147:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025217536:0@lo:400:kworker.0 00010000:00080000:1.0:1788658486.210162:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cce00 x1875544025217920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658486.210171:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025217920:0@lo:400:kworker.0 00010000:00080000:1.0:1788658486.210179:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eec700 x1875544025218432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658502 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658486.210187:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025218432:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.210220:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025217280:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.210229:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025217792:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.210237:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025218304:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.210245:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84e24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025217152:0@lo:400:kworker.0 00000100:00100000:3.0:1788658486.210571:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025218176 00000100:00100000:3.0:1788658486.210578:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025218176 00000100:00100000:3.0:1788658486.210615:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025218688 00000100:00100000:3.0:1788658486.210617:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025218688 00000100:00100000:3.0:1788658486.210630:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025218048 00000100:00100000:3.0:1788658486.210632:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025218048 00000100:00100000:3.0:1788658486.210644:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025218560 00000100:00100000:3.0:1788658486.210646:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025218560 00000100:00100000:3.0:1788658486.210668:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788658486.210674:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025218176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658486.210735:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025218176:12345-0@lo:400:kworker.0 Request processed in 62us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.210741:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788658486.210755:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788658486.210761:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025218688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658486.210786:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025218688:12345-0@lo:400:kworker.0 Request processed in 25us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.210791:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788658486.210800:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788658486.210804:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025218048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658486.210827:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025218048:12345-0@lo:400:kworker.0 Request processed in 23us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.210833:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788658486.210842:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788658486.210847:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025218560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658486.210870:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025218560:12345-0@lo:400:kworker.0 Request processed in 23us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.210874:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788658486.210890:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025217664 00000100:00100000:3.0:1788658486.210893:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025217664 00000100:00100000:3.0:1788658486.210916:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025217408 00000100:00100000:3.0:1788658486.210919:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025217408 00000100:00100000:3.0:1788658486.210930:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788658486.210935:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025217664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658486.210979:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025217664:12345-0@lo:400:kworker.0 Request processed in 44us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.210986:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788658486.210999:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788658486.211005:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025217408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658486.211032:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025217408:12345-0@lo:400:kworker.0 Request processed in 28us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658486.211037:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788658486.214408:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025218816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658486.214509:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658486.214589:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025218816 00000100:00100000:2.0:1788658486.214598:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025218816 00000100:00100000:2.0:1788658486.214657:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788658486.214667:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025218816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658486.214722:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788658486.214774:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025218816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658486.214793:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788658486.214852:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025218816:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788658486.216103:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658486.216114:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658486.216175:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025218048:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.216189:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d831bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025218560:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.216203:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025217408:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.216253:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025217664:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.216267:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025218176:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.216280:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025218688:0@lo:400:kworker.0 00000100:00100000:1.0:1788658486.216538:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025218944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658486.216612:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658486.216784:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025218944 00000100:00100000:2.0:1788658486.216792:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025218944 00000100:00100000:2.0:1788658486.216853:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788658486.216862:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025218944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658486.216890:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788658486.216939:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025218944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658486.216947:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788658486.217022:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025218944:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788658486.495068:0:14525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:34:44 (1788658484) 00000100:00100000:1.0:1788658486.719867:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658486.719906:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025219072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658486.719986:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.720103:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025219072 00000100:00100000:1.0:1788658486.720111:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025219072 00000100:00100000:1.0:1788658486.720160:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788658486.720170:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025219072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658486.720199:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658486.720255:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025219072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.720263:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788658486.720326:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025219072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788658486.721145:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658486.721507:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658486.721524:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025219200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658486.721571:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658486.721607:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025219200 00000100:00100000:1.0:1788658486.721612:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025219200 00000100:00100000:1.0:1788658486.721645:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788658486.721654:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025219200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658486.721676:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658486.721736:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025219200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658486.721743:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788658486.722093:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e9836a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025219200:0@lo:13:osp-pre-0-1.0 00000040:00080000:1.0:1788658487.039637:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788658487.231132:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658487.231153:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025219328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658487.231222:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658487.231368:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025219328 00000100:00100000:0.0:1788658487.231377:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025219328 00000100:00100000:0.0:1788658487.231420:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788658487.231437:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025219328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658487.231473:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788658487.231517:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025219328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658487.231524:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788658487.231827:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025219328:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788658487.550928:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658487.550939:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658487.551046:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788658487.551067:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788658487.743049:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658488.133692:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658488.135622:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001027968 00000100:00100000:1.0:1788658488.135637:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001027968 00000100:00100000:1.0:1788658488.135836:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 150 00000100:00100000:1.0:1788658488.135850:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:12149:x1875544001027968:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658488.135873:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658488.135911:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f2b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc901 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.135990:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f2b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136006:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136021:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136075:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f2be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136084:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f2be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136092:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f2be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136204:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f2c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136213:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136219:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f2c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658488.136229:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788658488.136313:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f2b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136321:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f2b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136328:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f2b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136333:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658488.136338:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f2b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136357:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f2b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136370:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1e90e70000) 00010000:00010000:1.0:1788658488.136373:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658488.136377:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f2b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136383:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f2b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136398:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f2be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136404:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f2be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136410:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f2be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136415:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658488.136419:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f2be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136425:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f2be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136433:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a1eb35f0100) 00010000:00010000:1.0:1788658488.136435:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658488.136438:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f2be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136454:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f2be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136881:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f2b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc901 expref: 16 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136896:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f2c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc901 expref: 15 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658488.136904:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:1.0:1788658488.136906:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658488.136909:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418800, rc 0) 00000100:00100000:1.0:1788658488.136979:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:12149:x1875544001027968:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 1133us (3296us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788658488.136987:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 150 00000100:00100000:3.0:1788658488.141000:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658488.141349:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658488.141512:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001028096 00000100:00100000:1.0:1788658488.141530:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001028096 00000100:00100000:1.0:1788658488.141613:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 151 00000100:00100000:1.0:1788658488.141624:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:12149:x1875544001028096:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788658488.141780:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:12149:x1875544001028096:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 158us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658488.141788:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 151 00000100:00080000:2.0:1788658488.143256:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658488.143456:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658488.143612:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001028352 00000100:00100000:2.0:1788658488.143622:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001028352 00000100:00100000:2.0:1788658488.143726:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 152 00000100:00100000:2.0:1788658488.143737:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:12149:x1875544001028352:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788658488.143853:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:12149:x1875544001028352:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 118us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658488.143860:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 152 00000100:00080000:1.0:1788658488.144575:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658488.145548:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001028224 00000100:00100000:0.0:1788658488.145567:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001028224 00000100:00100000:0.0:1788658488.145672:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:0.0:1788658488.145684:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:2399:x1875544001028224:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658488.145718:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658488.145763:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f2c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc901 expref: 15 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658488.145793:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:0.0:1788658488.145800:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658488.145897:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:2399:x1875544001028224:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 215us (4547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658488.145905:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:3.0:1788658488.513831:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658488.513896:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658488.513934:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658488.513973:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658488.514001:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658488.514038:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001028864 00000100:00100000:3.0:1788658488.514050:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001028864 00000100:00100000:3.0:1788658488.514139:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001028992 00000100:00100000:3.0:1788658488.514143:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001028992 00000100:00100000:3.0:1788658488.514174:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 337 00000100:00100000:3.0:1788658488.514196:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2399:x1875544001028864:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658488.514296:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2399:x1875544001028864:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 102us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658488.514304:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 337 00000100:00100000:3.0:1788658488.514324:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 338 00000100:00100000:3.0:1788658488.514330:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544001028992:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658488.514353:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2399:x1875544001028992:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658488.514359:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 338 00000100:00100000:3.0:1788658488.514378:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001028480 00000100:00100000:3.0:1788658488.514381:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001028480 00000100:00100000:3.0:1788658488.514407:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 390 00000100:00100000:3.0:1788658488.514413:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544001028480:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658488.514436:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2399:x1875544001028480:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658488.514442:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 390 00000100:00100000:3.0:1788658488.514471:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001028608 00000100:00100000:3.0:1788658488.514474:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001028608 00000100:00100000:3.0:1788658488.514502:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001028736 00000100:00100000:3.0:1788658488.514505:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001028736 00000100:00100000:3.0:1788658488.514523:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:3.0:1788658488.514529:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544001028608:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658488.514551:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2399:x1875544001028608:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658488.514558:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:3.0:1788658488.514574:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 124 00000100:00100000:3.0:1788658488.514579:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544001028736:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658488.514603:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2399:x1875544001028736:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658488.514609:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 124 00000100:00080000:3.0:1788658488.514626:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658488.514631:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658488.514633:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658488.514635:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788658488.575913:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658488.575927:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658488.576495:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1788658488.576508:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788658488.772053:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788658489.088874:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788658489.791144:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83672300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025219456:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788658489.791161:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658489.791268:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658489.791614:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025219456 00000100:00100000:2.0:1788658489.791624:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025219456 00000100:00100000:2.0:1788658489.791696:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788658489.791737:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025219456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658489.791775:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788658489.791825:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025219456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658489.791831:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788658489.792006:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83672300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025219456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658490.552562:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658490.552647:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001029120 00000100:00100000:3.0:1788658490.552657:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001029120 00000100:00100000:3.0:1788658490.552754:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 153 00000100:00100000:3.0:1788658490.552765:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:12192:x1875544001029120:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658490.552783:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658490.552803:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f2d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc908 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.552963:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f2da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.552977:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f2da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.552990:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f2da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553014:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f2e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553021:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553028:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553070:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f2da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553078:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f2da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553084:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f2da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553091:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658490.553095:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f2da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553104:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f2da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553116:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:3.0:1788658490.553119:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658490.553124:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f2da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553131:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031800/0x48e67cc629c6f2da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553151:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553158:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f2e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553164:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553170:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658490.553173:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553180:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f2e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553188:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a1eadbbf400) 00010000:00010000:3.0:1788658490.553190:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658490.553194:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f2e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553199:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031400/0x48e67cc629c6f2e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553229:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f2d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc908 expref: 15 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553240:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:3.0:1788658490.553242:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658490.553251:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031600/0x48e67cc629c6f2d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc908 expref: 15 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.553262:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e80031600, rc 0) 00000100:00080000:0.0:1788658490.553374:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658490.553397:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:12192:x1875544001029120:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 635us (856us total) trans 0 rc 301/301 00000100:00100000:3.0:1788658490.553403:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 153 00000100:00100000:3.0:1788658490.558517:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658490.558612:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001029376 00000100:00100000:0.0:1788658490.558623:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001029376 00000100:00100000:0.0:1788658490.558689:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 154 00000100:00100000:0.0:1788658490.558699:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:12192:x1875544001029376:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:0.0:1788658490.558780:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658490.558807:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390800/0x48e67cc629c6ec27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc72c expref: 14 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.558827:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:0.0:1788658490.558832:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658490.558903:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.558917:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8fa expref: 5 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.558925:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.558958:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8fa expref: 5 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.558972:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8fa expref: 5 pid: 7958 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658490.558985:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875544025219584:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658490.559070:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658490.561537:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658490.561690:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875544025219584:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658490.561745:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658490.561835:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001029504 00000100:00100000:3.0:1788658490.561851:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001029504 00010000:00010000:3.0:1788658490.561912:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8fa expref: 6 pid: 7958 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658490.561949:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:3.0:1788658490.561958:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae3b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2397:x1875544001029504:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658490.561971:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658490.561978:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8fa expref: 6 pid: 7958 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.561990:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8fa expref: 6 pid: 7958 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562012:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f2a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8fa expref: 6 pid: 7958 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562028:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:3.0:1788658490.562033:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562052:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562060:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562085:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658490.562134:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae3b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544001029504:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 176us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658490.562143:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 79 00010000:00010000:3.0:1788658490.562277:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562285:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562308:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562318:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562326:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562920:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562932:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562949:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658490.562967:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000581fa305 reply state 0000000093b3429f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562978:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.562984:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658490.562987:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658490.562990:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788658490.562996:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788658490.563004:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.563011:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.563018:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.563025:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658490.563029:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.563037:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.563045:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:3.0:1788658490.563047:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658490.563057:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.563064:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f2e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658490.563082:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000581fa305 reply state 0000000093b3429f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.563091:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.563097:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a1eadbbf900) 00010000:00010000:3.0:1788658490.563099:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658490.563101:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788658490.563164:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:12192:x1875544001029376:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 4466us (4658us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788658490.563174:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 154 00000100:00080000:0.0:1788658490.563547:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658490.677928:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658490.678102:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001029632 00000100:00100000:3.0:1788658490.678112:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001029632 00000100:00100000:3.0:1788658490.678189:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 155 00000100:00100000:3.0:1788658490.678200:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+15:12200:x1875544001029632:12345-192.168.202.53@tcp:101:lctl.0 00010000:00010000:3.0:1788658490.678230:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658490.678258:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f2fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc90f expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.678339:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96a00/0x48e67cc629c6f304 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.678355:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96a00/0x48e67cc629c6f304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.678388:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96a00/0x48e67cc629c6f304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658490.678439:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788658490.678443:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658490.678470:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96a00/0x48e67cc629c6f304 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.678497:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f2fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc90f expref: 17 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.678522:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96a00/0x48e67cc629c6f304 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc90f expref: 16 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.678531:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e7ef00) 00010000:00010000:3.0:1788658490.678534:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658490.678549:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96a00, rc 0) 00000100:00100000:3.0:1788658490.678854:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:12200:x1875544001029632:12345-192.168.202.53@tcp:101:lctl.0 Request processed in 654us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658490.678862:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 155 00000100:00100000:3.0:1788658490.788310:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658490.788347:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001029760 00000100:00100000:3.0:1788658490.788358:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001029760 00000100:00100000:3.0:1788658490.788420:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 156 00000100:00100000:3.0:1788658490.788430:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+16:12206:x1875544001029760:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1788658490.788450:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658490.788474:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f30b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc916 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.788568:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f312 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.788584:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f312 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.788598:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f312 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.788610:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f319 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.788618:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.788624:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789160:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6f320 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789172:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6f320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789179:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6f320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658490.789218:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788658490.789222:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658490.789244:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6f320 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789269:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f312 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789276:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f312 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789284:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f312 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789290:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658490.789295:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f312 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789303:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f312 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789317:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e7ef00) 00010000:00010000:3.0:1788658490.789320:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658490.789326:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789333:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789350:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789358:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f319 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789363:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f319 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789374:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658490.789377:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f319 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789382:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f319 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789391:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a1eadbbf900) 00010000:00010000:3.0:1788658490.789394:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658490.789397:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f319 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789403:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f319 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789436:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f30b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc916 expref: 18 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789449:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6f320 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc916 expref: 17 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658490.789457:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658490.789459:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788658490.789462:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97a00, rc 0) 00000100:00100000:3.0:1788658490.789556:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:12206:x1875544001029760:12345-192.168.202.53@tcp:101:bash.0 Request processed in 1126us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658490.789565:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 156 00000100:00100000:1.0:1788658490.794327:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658490.795137:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001030016 00000100:00100000:0.0:1788658490.795148:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001030016 00000100:00100000:0.0:1788658490.796013:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 157 00000100:00100000:0.0:1788658490.796262:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:12206:x1875544001030016:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658490.796287:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658490.796310:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f327 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc91d expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.797000:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f32e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.797021:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f32e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.797157:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f32e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.797262:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.797272:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.797281:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658490.798418:0:6538:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788658490.798668:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.798681:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.798690:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.798744:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f32e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.798752:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f32e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.798758:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f32e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.798764:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658490.798769:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f32e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.798778:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f32e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.798789:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658490.798792:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658490.798797:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f32e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.800609:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f32e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658490.800633:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080cead9e reply state 00000000a66c154d transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.800647:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.800656:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1eb24baa00) 00010000:00010000:0.0:1788658490.800660:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658490.800664:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788658490.800725:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f327 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc91d expref: 20 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.800740:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc91d expref: 19 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.800746:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1eb24bab00) 00010000:00010000:0.0:1788658490.800748:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658490.800749:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671000, rc 0) 00000100:00100000:0.0:1788658490.800817:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:12206:x1875544001030016:12345-192.168.202.53@tcp:101:bash.0 Request processed in 4795us (6499us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788658490.800824:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 157 00000100:00100000:1.0:1788658490.805443:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658490.805591:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001030144 00000100:00100000:2.0:1788658490.805602:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001030144 00000100:00100000:2.0:1788658490.805761:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:2.0:1788658490.805771:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001030144:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658490.805789:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658490.805811:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6f34a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc924 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658490.805847:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658490.805867:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1788658490.805872:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658490.805882:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6f34a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc924 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658490.805913:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6f34a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc924 expref: 6 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658490.805951:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1200, rc 0) 00000100:00100000:2.0:1788658490.806021:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544001030144:12345-192.168.202.53@tcp:101:bash.0 Request processed in 251us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658490.806034:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00080000:0.0:1788658490.807738:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658490.809934:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658490.810005:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001030272 00000100:00100000:0.0:1788658490.810018:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001030272 00000100:00100000:0.0:1788658490.810081:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1788658490.810093:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:12206:x1875544001030272:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658490.810118:0:13833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658490.810137:0:13833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc92b expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.810170:0:13833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6f34a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc924 expref: 7 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.810180:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658490.810185:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658490.810191:0:13833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 7 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.810226:0:13833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6f34a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc924 expref: 7 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.810240:0:13833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6f34a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc924 expref: 7 pid: 8453 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658490.810255:0:13833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13833:1875544025219712:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658490.810362:0:13833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0540 going to sleep for 11 seconds 00010000:00010000:3.0:1788658490.814891:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658490.815064:0:13833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13833:1875544025219712:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658490.815102:0:13833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 7 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.815128:0:13833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670c00, rc 0) 00000100:00100000:0.0:1788658490.815199:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:12206:x1875544001030272:12345-192.168.202.53@tcp:101:bash.0 Request processed in 5108us (5275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658490.815208:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:1.0:1788658490.816160:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658490.816234:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001030400 00000100:00100000:0.0:1788658490.816243:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001030400 00010000:00010000:0.0:1788658490.816282:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6f34a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc924 expref: 7 pid: 8453 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658490.816324:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:0.0:1788658490.816336:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2396:x1875544001030400:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658490.816350:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658490.816373:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6f34a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc924 expref: 7 pid: 8453 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.816387:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6f34a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc924 expref: 7 pid: 8453 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.816410:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6f34a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc924 expref: 7 pid: 8453 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.816436:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658490.816441:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658490.816450:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 6 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.816462:0:9539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 6 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658490.816511:0:9539:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 6 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658490.816536:0:9539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1875544025219840:192.168.202.53@tcp:105: 00000100:00100000:0.0:1788658490.816611:0:9539:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658490.823740:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658490.826719:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001030656 00000100:00100000:2.0:1788658490.826735:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001030656 00000100:00100000:2.0:1788658490.826817:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:2.0:1788658490.826828:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:12206:x1875544001030656:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1788658490.827170:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:12206:x1875544001030656:12345-192.168.202.53@tcp:35:bash.0 Request processed in 343us (3477us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788658490.827179:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:0.0:1788658490.830195:0:9539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1875544025219840:192.168.202.53@tcp:105: 00010000:00010000:0.0:1788658490.830227:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658490.830301:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2396:x1875544001030400:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 13967us (14145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658490.830312:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:3.0:1788658490.956140:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658490.956217:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001030912 00000100:00100000:2.0:1788658490.956229:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001030912 00000100:00100000:2.0:1788658490.956300:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 158 00000100:00100000:2.0:1788658490.956312:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:12216:x1875544001030912:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658490.956338:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658490.956359:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f358 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc932 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658490.956475:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788658490.956601:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f358 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc932 expref: 23 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658490.956617:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e7ef00) 00010000:00010000:2.0:1788658490.956637:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658490.956643:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc932 expref: 23 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658490.956659:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1600, rc 0) 00000100:00100000:2.0:1788658490.956779:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:12216:x1875544001030912:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 469us (649us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1788658490.956787:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 158 00000100:00100000:1.0:1788658490.961386:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658490.961520:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001031168 00000100:00100000:3.0:1788658490.961530:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001031168 00000100:00100000:3.0:1788658490.961582:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:3.0:1788658490.961592:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:12216:x1875544001031168:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:3.0:1788658490.961848:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:12216:x1875544001031168:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 257us (481us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788658490.962107:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:0.0:1788658491.042314:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658491.042542:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001031296 00000100:00100000:3.0:1788658491.042552:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001031296 00000100:00100000:3.0:1788658491.042724:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:3.0:1788658491.042733:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:12222:x1875544001031296:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658491.042760:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658491.042792:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc939 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.042854:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f36d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.042868:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f36d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.042880:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f36d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658491.042924:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788658491.042928:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658491.042961:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f36d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.042982:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc939 expref: 25 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.043000:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f36d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc939 expref: 24 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.043009:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658491.043012:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658491.043016:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97c00, rc 0) 00000100:00100000:3.0:1788658491.043074:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12222:x1875544001031296:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 341us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.043082:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:0.0:1788658491.047456:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658491.047570:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001031552 00000100:00100000:3.0:1788658491.047578:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001031552 00000100:00100000:3.0:1788658491.047637:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 160 00000100:00100000:3.0:1788658491.047648:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12222:x1875544001031552:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658491.047668:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658491.047687:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f374 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc940 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.048078:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f37b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.048091:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.048100:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658491.048119:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788658491.048221:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f374 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc940 expref: 27 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.048237:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f37b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc940 expref: 26 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.048242:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1eb24bab00) 00010000:00010000:3.0:1788658491.048245:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658491.048247:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96600, rc 0) 00000100:00100000:3.0:1788658491.048296:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:12222:x1875544001031552:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 650us (1239us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1788658491.048306:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 160 00000100:00100000:1.0:1788658491.052287:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658491.053275:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001031680 00000100:00100000:3.0:1788658491.053286:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001031680 00000100:00100000:3.0:1788658491.053399:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:3.0:1788658491.053411:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:2399:x1875544001031680:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658491.053427:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658491.053453:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f37b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc940 expref: 26 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.053473:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1eb24bab00) 00010000:00010000:3.0:1788658491.053478:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658491.053552:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:2399:x1875544001031680:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 143us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.053559:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1788658491.053610:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658491.053735:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001031936 00000100:00100000:2.0:1788658491.053739:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001031936 00000100:00100000:2.0:1788658491.053771:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 161 00000100:00100000:2.0:1788658491.053779:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:12222:x1875544001031936:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658491.053798:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658491.053813:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f389 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc947 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.053912:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f390 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.053927:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.053940:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f390 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658491.053952:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788658491.054046:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f389 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc947 expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.054075:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f390 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc947 expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.054084:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1eb24bab00) 00010000:00010000:2.0:1788658491.054087:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788658491.054090:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1a00, rc 0) 00000100:00100000:2.0:1788658491.054143:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12222:x1875544001031936:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 364us (533us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1788658491.054150:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 161 00000100:00100000:0.0:1788658491.063483:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658491.068570:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001032064 00000100:00100000:3.0:1788658491.068592:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001032064 00000100:00100000:3.0:1788658491.068672:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:3.0:1788658491.068683:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544001032064:12345-192.168.202.53@tcp:1:lfs.0 00010000:00010000:3.0:1788658491.068761:0:8454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.068794:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 6 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.068804:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658491.068809:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658491.068813:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.068852:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 6 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.068867:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 6 pid: 13833 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658491.068882:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1875544025219968:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658491.068990:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658491.076840:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658491.076943:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001032192 00000100:00100000:2.0:1788658491.076954:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001032192 00002000:00100000:2.0:1788658491.077007:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8a1d837cce00 x1875544001032192/t0(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:82/0 lens 504/0 e 0 to 0 dl 1788658502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788658491.077019:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d837cce00 with x1875544001032192 ext(0->12) 00010000:00010000:2.0:1788658491.077029:0:8458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 7 pid: 13833 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.077047:0:8458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 7 pid: 13833 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658491.077056:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a1d837cce00 00000100:00100000:2.0:1788658491.077094:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:2.0:1788658491.077104:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001032192:12345-192.168.202.53@tcp:4:lfs.0 00000100:00100000:3.0:1788658491.078074:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8454:1875544025219968:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658491.078104:0:8454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658491.078223:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2397:x1875544001032192:12345-192.168.202.53@tcp:4:lfs.0 Request processed in 1119us (1393us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788658491.078239:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00002000:00100000:2.0:1788658491.078248:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8a1d837cce00 x1875544001032192/t4294967306(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:82/0 lens 504/448 e 0 to 0 dl 1788658502 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788658491.078257:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d837cce00 with x1875544001032192 ext(0->12) 00010000:00010000:2.0:1788658491.078264:0:8458:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 9 pid: 13833 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.078276:0:8458:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 9 pid: 13833 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658491.078284:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a1d837cce00 00000100:00100000:0.0:1788658491.082056:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658491.082232:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001032320 00000100:00100000:1.0:1788658491.082244:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001032320 00010000:00010000:1.0:1788658491.082287:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 9 pid: 13833 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658491.082329:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:1.0:1788658491.082338:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2399:x1875544001032320:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658491.082359:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788658491.082376:0:6522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788658491.082379:0:6522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788658490 00002000:00010000:1.0:1788658491.082382:0:6522:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788658490 00002000:00010000:1.0:1788658491.082384:0:6522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788658490 00002000:00010000:1.0:1788658491.082386:0:6522:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788658491.082392:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 9 pid: 13833 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.082406:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 9 pid: 13833 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.082455:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a55de33/0x48e67cc629c6f351 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc92b expref: 9 pid: 13833 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.082472:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658491.082477:0:6522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658491.082483:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.082505:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.082541:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658491.082755:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2399:x1875544001032320:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 365us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658491.082767:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 81 00010000:00010000:3.0:1788658491.082769:0:8454:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.082792:0:8454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.082814:0:8454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.082822:0:8454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.082831:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.082838:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658491.082843:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.082852:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.082865:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.082885:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f39e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658491.082941:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001032064:12345-192.168.202.53@tcp:1:lfs.0 Request processed in 14260us (19468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.082950:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1788658491.091610:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658491.091826:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001032576 00000100:00100000:3.0:1788658491.091836:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001032576 00000100:00100000:3.0:1788658491.091945:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:3.0:1788658491.091966:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12222:x1875544001032576:12345-192.168.202.53@tcp:35:lfs.0 00000004:00010000:3.0:1788658491.092034:0:6540:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f390 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc947 expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658491.092254:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788658491.092282:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788658491.092617:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1788658491.092665:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.092680:0:6540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc91d expref: 31 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.092690:0:6540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.092752:0:6540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc91d expref: 31 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.092778:0:6540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc91d expref: 31 pid: 6538 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658491.092794:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6540:1875544025220096:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658491.092869:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3561900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658491.106673:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658491.106861:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001032704 00000100:00100000:0.0:1788658491.106872:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001032704 00010000:00010000:0.0:1788658491.106917:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc91d expref: 32 pid: 6538 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658491.106964:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 82 00000100:00100000:0.0:1788658491.106975:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:2396:x1875544001032704:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658491.106991:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658491.107010:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc91d expref: 32 pid: 6538 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.107023:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc91d expref: 32 pid: 6538 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.107046:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1eb24bab00) 00010000:00010000:0.0:1788658491.107051:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.107061:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.107069:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.107088:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658491.107147:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:2396:x1875544001032704:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 173us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658491.107155:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 82 00010000:00010000:3.0:1788658491.107266:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f33c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc91d expref: 31 pid: 6538 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658491.107286:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6540:1875544025220096:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658491.107308:0:6540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.107317:0:6540:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.107326:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658491.107453:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1788658491.107569:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1788658491.107667:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875544025220224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788658491.107761:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658491.107785:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788658491.109547:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025220224 00000100:00100000:2.0:1788658491.109562:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025220224 00000100:00100000:2.0:1788658491.109640:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00080000:0.0:1788658491.109758:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658491.109897:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6540:x1875544025220224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788658491.110026:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6540:x1875544025220224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 378us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658491.110032:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788658491.110214:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875544025220224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788658491.110378:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1788658491.110446:0:6540:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875544025220352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788658491.110516:0:6540:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658491.110536:0:6540:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2168d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658491.110655:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025220352 00000100:00100000:0.0:1788658491.110661:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025220352 00000100:00100000:0.0:1788658491.110698:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788658491.110731:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6540:x1875544025220352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788658491.110845:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6540:x1875544025220352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (328us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788658491.110853:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788658491.111124:0:6540:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6540:1875544025220352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788658491.111164:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788658491.111194:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.111205:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.111214:0:6540:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.111220:0:6540:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658491.111225:0:6540:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.111233:0:6540:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.111249:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1eb24bab00) 00010000:00010000:3.0:1788658491.111253:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788658491.111258:0:6540:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.111265:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3a5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658491.111434:0:6540:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788658491.111505:0:6540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788658491.111516:0:6540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 408327812112ns, next at 409327810114ns, rc = 0 00000001:00080000:3.0:1788658491.111531:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788658491.111553:0:6540:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1eb24bab00) 00010000:00010000:3.0:1788658491.111556:0:6540:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788658491.111563:0:6540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f390 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc947 expref: 35 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658491.112307:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+34:12222:x1875544001032576:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 20340us (20702us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788658491.112319:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00000020:00080000:3.0:1788658491.112323:0:6540:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788658491.120773:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658491.120865:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001032832 00000100:00100000:3.0:1788658491.120875:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001032832 00000100:00100000:3.0:1788658491.120944:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 162 00000100:00100000:3.0:1788658491.120956:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+34:12222:x1875544001032832:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658491.120980:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658491.121021:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f3ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc94e expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.121078:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f3ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc94e expref: 35 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.121090:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f3ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc94e expref: 35 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.121103:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:3.0:1788658491.121105:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658491.121109:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97800, rc 0) 00000100:00100000:3.0:1788658491.121165:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:12222:x1875544001032832:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 212us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.121182:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 162 00000100:00100000:0.0:1788658491.126305:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658491.126417:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001033088 00000100:00100000:2.0:1788658491.126428:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001033088 00000100:00100000:2.0:1788658491.126507:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:2.0:1788658491.126518:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:12222:x1875544001033088:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1788658491.126784:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+36:12222:x1875544001033088:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 268us (487us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788658491.126797:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:2.0:1788658491.269873:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658491.273577:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001033344 00000100:00100000:3.0:1788658491.273593:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001033344 00000100:00100000:3.0:1788658491.274217:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 163 00000100:00100000:3.0:1788658491.274230:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+36:12232:x1875544001033344:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658491.274256:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658491.274279:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc955 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658491.274413:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788658491.274523:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc955 expref: 38 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.274538:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e7ef00) 00010000:00010000:3.0:1788658491.274541:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658491.274547:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc955 expref: 38 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.274562:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96600, rc 0) 00000100:00100000:3.0:1788658491.274684:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+37:12232:x1875544001033344:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 401us (4764us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1788658491.274690:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 163 00000100:00100000:3.0:1788658491.282146:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658491.282534:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001033472 00000100:00100000:2.0:1788658491.282546:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001033472 00000100:00100000:2.0:1788658491.282611:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:2.0:1788658491.282621:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+37:12232:x1875544001033472:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:2.0:1788658491.282754:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f3c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.282772:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f3c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.282786:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f3c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.282799:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f3c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.282807:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.282813:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.282889:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.282898:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.282905:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658491.282968:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.282982:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f3c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.282988:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f3c1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283217:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f3c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283224:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658491.283229:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f3c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283236:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f3c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283249:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:2.0:1788658491.283252:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658491.283257:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f3c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283262:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f3c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283276:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f3c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283281:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f3c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283294:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283298:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658491.283301:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f3c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283307:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f3c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283314:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1eb24baa00) 00010000:00010000:2.0:1788658491.283316:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658491.283320:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f3c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283325:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f3c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283334:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283339:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283346:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283351:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658491.283354:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283370:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283380:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:2.0:1788658491.283382:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658491.283386:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658491.283397:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f3cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658491.283499:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+37:12232:x1875544001033472:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 877us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658491.283508:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:0.0:1788658491.290898:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658491.290997:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001033728 00000100:00100000:3.0:1788658491.291008:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001033728 00000100:00100000:3.0:1788658491.291085:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:3.0:1788658491.291096:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+37:12232:x1875544001033728:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:3.0:1788658491.291350:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:12232:x1875544001033728:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 255us (461us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788658491.291358:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:1.0:1788658491.327332:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025220608:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.327407:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658491.327575:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025220864:0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.327624:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025220736:0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.327659:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658491.327724:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025221248:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.327831:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025221120:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.327854:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658491.327873:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025221632:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.327892:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658491.327928:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658491.327944:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025221376:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.327968:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658491.328003:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025221888:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.328026:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658491.328044:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788658491.328137:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025220608 00000100:00100000:3.0:1788658491.328145:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025220608 00000100:00100000:3.0:1788658491.328191:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025221120 00000100:00100000:3.0:1788658491.328194:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025221120 00000100:00100000:3.0:1788658491.328215:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025221632 00000100:00100000:3.0:1788658491.328217:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025221632 00000100:00100000:3.0:1788658491.328230:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025220864 00000100:00100000:3.0:1788658491.328232:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025220864 00000100:00100000:3.0:1788658491.328245:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788658491.328253:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025220608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.328315:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025220608:12345-0@lo:400:kworker.0 Request processed in 62us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.328322:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1788658491.328339:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788658491.328346:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025221120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.328372:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025221120:12345-0@lo:400:kworker.0 Request processed in 28us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.328378:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1788658491.328398:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788658491.328404:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025221632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.328445:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025221632:12345-0@lo:400:kworker.0 Request processed in 42us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.328452:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788658491.328474:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788658491.328481:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025220864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.328508:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025220864:12345-0@lo:400:kworker.0 Request processed in 27us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.328513:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00080000:0.0:1788658491.328734:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658491.328739:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658491.328766:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025221376 00000100:00100000:0.0:1788658491.328770:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025221376 00000100:00100000:0.0:1788658491.328805:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025221888 00000100:00100000:0.0:1788658491.328808:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025221888 00000100:00100000:0.0:1788658491.328825:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788658491.328832:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025221376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658491.328868:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025221376:12345-0@lo:400:kworker.0 Request processed in 37us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658491.328875:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788658491.328889:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788658491.328894:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025221888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658491.328920:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025221888:12345-0@lo:400:kworker.0 Request processed in 26us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658491.328926:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788658491.328939:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658491.328942:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658491.328951:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658491.328975:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025221760:0@lo:400:kworker.0 00000100:00100000:0.0:1788658491.328999:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658491.329025:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025221760 00000100:00100000:0.0:1788658491.329028:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025221760 00000100:00100000:0.0:1788658491.329064:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788658491.329071:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025221760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658491.329105:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025221760:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658491.329123:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1788658491.329136:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658491.329162:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025221760:0@lo:400:kworker.0 00000100:00100000:0.0:1788658491.329181:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025221248 00000100:00100000:0.0:1788658491.329184:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025221248 00000100:00100000:0.0:1788658491.329206:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788658491.329212:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025221248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658491.329243:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025221248:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658491.329249:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788658491.330398:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025220480:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.330538:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658491.330724:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025220480 00000100:00100000:2.0:1788658491.330731:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025220480 00000100:00100000:2.0:1788658491.330773:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788658491.330782:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025220480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658491.330825:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025220480:12345-0@lo:400:kworker.0 Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658491.330832:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788658491.330881:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025222016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658491.330910:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658491.331060:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025220736 00000100:00100000:3.0:1788658491.331065:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025220736 00000100:00100000:3.0:1788658491.331094:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788658491.331101:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e82e55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025220736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.331140:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e82e55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025220736:12345-0@lo:400:kworker.0 Request processed in 41us (3481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.331147:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788658491.331478:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025222016 00000100:00100000:3.0:1788658491.331482:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025222016 00000100:00100000:3.0:1788658491.331509:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788658491.331515:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025222016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788658491.331537:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788658491.331570:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025222016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.331577:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1788658491.332440:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658491.336999:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658491.337049:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001033984 00000100:00100000:3.0:1788658491.337058:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001033984 00000100:00100000:3.0:1788658491.337106:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 165 00000100:00100000:3.0:1788658491.337116:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:12235:x1875544001033984:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658491.337140:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658491.337160:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc95c expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337253:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f3dd lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337269:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f3dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337280:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f3dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337290:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f3e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337297:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337303:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337407:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337416:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337434:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658491.337444:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788658491.337533:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f3dd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337541:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f3dd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337559:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f3dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337566:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658491.337571:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f3dd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337579:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f3dd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337593:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658491.337596:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658491.337600:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f3dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337606:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f3dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337631:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f3e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337637:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f3e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337649:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337654:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658491.337657:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f3e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337664:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f3e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337672:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1eb24baa00) 00010000:00010000:3.0:1788658491.337675:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658491.337678:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f3e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337683:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f3e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337743:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f3d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc95c expref: 41 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337758:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc95c expref: 40 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.337764:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:3.0:1788658491.337766:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658491.337769:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96200, rc 0) 00000100:00100000:3.0:1788658491.337833:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+40:12235:x1875544001033984:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 718us (853us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788658491.337850:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 165 00000100:00100000:1.0:1788658491.338577:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025220480:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.338593:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025220992:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.338642:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658491.338691:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025221504:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.338734:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658491.338763:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025221504 00000100:00100000:1.0:1788658491.338768:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025221504 00000100:00100000:1.0:1788658491.338814:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788658491.338822:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025221504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.338860:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025221504:12345-0@lo:400:kworker.0 Request processed in 39us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658491.338867:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788658491.338899:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025222144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658491.338927:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658491.338956:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025220608:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.338970:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025221120:0@lo:400:kworker.0 00010000:00080000:1.0:1788658491.338984:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83799f80 x1875544025221632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658491.338993:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025221632:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.339034:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025222144 00000100:00100000:1.0:1788658491.339037:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025222144 00000100:00080000:0.0:1788658491.339578:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658491.339606:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025220736:0@lo:400:kworker.0 00010000:00080000:0.0:1788658491.339620:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83755500 x1875544025221248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658491.339631:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025221248:0@lo:400:kworker.0 00000100:00100000:0.0:1788658491.339673:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025221504:0@lo:400:kworker.0 00000100:00100000:0.0:1788658491.339685:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025220864:0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.339695:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025220992 00000100:00100000:0.0:1788658491.339722:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025221376:0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.339730:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025220992 00000100:00100000:0.0:1788658491.339739:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025221888:0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.339776:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788658491.339787:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025220992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658491.339850:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025220992:12345-0@lo:400:kworker.0 Request processed in 66us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.339857:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788658491.340125:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83469c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025222016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658491.340170:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788658491.340179:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025222144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788658491.340195:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788658491.340251:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025222144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658491.340361:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025220992:0@lo:400:kworker.0 00000100:00100000:1.0:1788658491.340396:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788658491.340868:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d81b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025222144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788658491.346620:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658491.347161:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001034112 00000100:00100000:1.0:1788658491.347171:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001034112 00000100:00100000:1.0:1788658491.347233:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 166 00000100:00100000:1.0:1788658491.347244:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+40:12235:x1875544001034112:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:1.0:1788658491.347440:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f3f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.347458:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.347482:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.347519:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.347527:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f3f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.347534:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.347557:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658491.347562:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.347572:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f3f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.347585:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:1.0:1788658491.347588:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658491.347593:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f3f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.347600:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f3f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658491.347682:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+40:12235:x1875544001034112:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 440us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658491.347690:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 166 00000100:00100000:0.0:1788658491.361275:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658491.361398:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001034368 00000100:00100000:1.0:1788658491.361418:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001034368 00000100:00100000:1.0:1788658491.361488:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:1.0:1788658491.361499:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+40:12235:x1875544001034368:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658491.361748:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+41:12235:x1875544001034368:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 250us (492us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788658491.361756:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:3.0:1788658491.769260:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658491.769954:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001034624 00000100:00100000:0.0:1788658491.769966:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001034624 00000100:00100000:0.0:1788658491.770042:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 167 00000100:00100000:0.0:1788658491.770054:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+41:12266:x1875544001034624:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:0.0:1788658491.770084:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658491.770108:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f400 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc963 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.770248:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.770268:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.770284:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658491.770299:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788658491.770766:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f400 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc963 expref: 44 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.770787:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc963 expref: 43 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.770797:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658491.770800:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658491.770803:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670600, rc 0) 00000100:00100000:0.0:1788658491.770885:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:12266:x1875544001034624:12345-192.168.202.53@tcp:101:cat.0 Request processed in 833us (1635us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788658491.770915:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 167 00000100:00100000:2.0:1788658491.781090:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658491.781235:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001034752 00000100:00100000:0.0:1788658491.781246:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001034752 00000100:00100000:0.0:1788658491.781324:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:0.0:1788658491.781335:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:2398:x1875544001034752:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658491.781353:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658491.781378:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc963 expref: 43 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.781400:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658491.781405:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658491.781487:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+42:2398:x1875544001034752:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 153us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658491.781495:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:2.0:1788658491.784319:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658491.791119:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001035008 00000100:00100000:1.0:1788658491.791137:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001035008 00000100:00100000:1.0:1788658491.791658:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:1.0:1788658491.791686:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+42:12266:x1875544001035008:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:1.0:1788658491.792000:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:12266:x1875544001035008:12345-192.168.202.53@tcp:35:cat.0 Request processed in 315us (7690us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1788658491.792009:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:0.0:1788658491.839124:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025222272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658491.839198:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658491.839495:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658491.839575:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658491.839595:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025222400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658491.839629:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658491.839825:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025222272 00000100:00100000:3.0:1788658491.839833:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025222272 00000100:00100000:3.0:1788658491.839868:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025222400 00000100:00100000:3.0:1788658491.839871:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025222400 00000100:00100000:3.0:1788658491.839887:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788658491.839896:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025222272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658491.839920:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658491.839988:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025222272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.839996:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788658491.840015:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788658491.840022:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025222400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658491.840031:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658491.840065:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025222400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.840089:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788658491.840288:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025222272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658491.840364:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025222400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658491.900088:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658491.900282:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001035264 00000100:00100000:0.0:1788658491.900292:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001035264 00000100:00100000:0.0:1788658491.900350:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 168 00000100:00100000:0.0:1788658491.900357:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:12272:x1875544001035264:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:0.0:1788658491.900378:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658491.900381:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788658491.900414:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f36d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc939 expref: 43 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.900456:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658491.900462:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658491.900478:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f415 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc96a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.900572:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.900583:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc95c expref: 43 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.900589:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.900616:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc95c expref: 43 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.900625:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc95c expref: 43 pid: 11974 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658491.900636:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025222528:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658491.901549:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658491.904765:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658491.904990:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001035392 00000100:00100000:3.0:1788658491.904998:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001035392 00010000:00010000:3.0:1788658491.905086:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc95c expref: 44 pid: 11974 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658491.905117:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 83 00000100:00100000:3.0:1788658491.905124:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+44:2396:x1875544001035392:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658491.905137:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658491.905143:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc95c expref: 44 pid: 11974 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.905153:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc95c expref: 44 pid: 11974 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.905170:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:3.0:1788658491.905174:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.905182:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.905186:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658491.905200:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658491.905244:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+44:2396:x1875544001035392:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 120us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658491.905261:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 83 00010000:00010000:0.0:1788658491.905344:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f3eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc95c expref: 43 pid: 11974 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658491.905359:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025222528:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658491.905383:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.905393:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.905410:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658491.905429:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788658491.905560:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f415 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc96a expref: 44 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.905572:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc96a expref: 43 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.905578:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658491.905580:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788658491.905582:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671400, rc 0) 00000100:00100000:0.0:1788658491.905602:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:12272:x1875544001035264:12345-192.168.202.53@tcp:101:dd.0 Request processed in 5247us (5525us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788658491.905606:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 168 00000100:00100000:2.0:1788658491.908492:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658491.908599:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001035520 00000100:00100000:1.0:1788658491.908609:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001035520 00000100:00100000:1.0:1788658491.908744:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 169 00000100:00100000:1.0:1788658491.908753:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:12272:x1875544001035520:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:1.0:1788658491.908772:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658491.908795:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f42a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc971 expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.908828:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.908840:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.908848:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.908958:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f42a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc971 expref: 45 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.908971:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc971 expref: 44 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658491.908977:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:1.0:1788658491.908984:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788658491.908987:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418600, rc 0) 00000100:00100000:1.0:1788658491.909034:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+44:12272:x1875544001035520:12345-192.168.202.53@tcp:101:dd.0 Request processed in 283us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658491.909039:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 169 00000100:00100000:2.0:1788658491.914583:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658491.914927:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001035776 00000100:00100000:0.0:1788658491.914938:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001035776 00000100:00100000:0.0:1788658491.914995:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 170 00000100:00100000:0.0:1788658491.915005:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+44:12272:x1875544001035776:12345-192.168.202.53@tcp:36:dd.0 00010000:00010000:0.0:1788658491.915240:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.915272:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.915284:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658491.915340:0:6538:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788658491.915361:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2b1496e reply state 00000000b0f750c2 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.915374:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658491.915382:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658491.915385:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658491.915389:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658491.915485:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+47:12272:x1875544001035776:12345-192.168.202.53@tcp:36:dd.0 Request processed in 480us (912us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788658491.915493:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 170 00000020:00080000:0.0:1788658491.915497:0:6538:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788658492.300491:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658492.300587:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001035904 00000100:00100000:0.0:1788658492.300598:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001035904 00000100:00100000:0.0:1788658492.300686:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 171 00000100:00100000:0.0:1788658492.300697:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+47:12286:x1875544001035904:12345-192.168.202.53@tcp:101:stat.0 00010000:00010000:0.0:1788658492.300754:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658492.300776:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f43f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc978 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.300843:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f446 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.300871:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.300883:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.300898:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f44d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.300906:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.300913:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.300982:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.300993:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc96a expref: 48 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.301002:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.301035:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc96a expref: 48 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.301049:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc96a expref: 48 pid: 6537 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658492.301075:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025222656:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658492.301176:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0540 going to sleep for 11 seconds 00000100:00080000:2.0:1788658492.301444:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658492.304278:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658492.304762:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025222656:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658492.304788:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658492.304925:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001036160 00000100:00100000:3.0:1788658492.304933:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001036160 00000100:00100000:3.0:1788658492.305048:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:3.0:1788658492.305059:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+49:6169:x1875544001036160:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788658492.305332:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+50:6169:x1875544001036160:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 274us (1063us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788658492.305340:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:3.0:1788658492.308122:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658492.311283:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001036288 00000100:00100000:0.0:1788658492.311299:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001036288 00010000:00010000:0.0:1788658492.311350:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc96a expref: 50 pid: 6537 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658492.311495:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 84 00000100:00100000:0.0:1788658492.311506:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+50:2397:x1875544001036288:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658492.311522:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658492.311529:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc96a expref: 50 pid: 6537 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.311543:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc96a expref: 50 pid: 6537 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.311563:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f41c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc96a expref: 50 pid: 6537 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.311580:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658492.311585:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.311611:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.311618:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.311668:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658492.311779:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae3bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+49:2397:x1875544001036288:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 274us (3665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658492.311787:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 84 00010000:00010000:2.0:1788658492.311893:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.311903:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658492.311956:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788658492.311960:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658492.311983:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.311996:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312005:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312012:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f446 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312030:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312036:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658492.312040:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312048:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f446 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312058:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:2.0:1788658492.312062:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658492.312066:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f446 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312074:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f446 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312086:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312094:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f44d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312101:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f44d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312107:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658492.312111:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f44d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312128:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f44d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312137:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1eb24baa00) 00010000:00010000:2.0:1788658492.312140:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658492.312143:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f44d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312151:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f44d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312182:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f43f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc978 expref: 49 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312197:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc978 expref: 48 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.312205:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:2.0:1788658492.312208:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658492.312210:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671a00, rc 0) 00000100:00100000:2.0:1788658492.312239:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+48:12286:x1875544001035904:12345-192.168.202.53@tcp:101:stat.0 Request processed in 11544us (11758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658492.312263:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 171 00000100:00100000:0.0:1788658492.351084:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025222784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658492.351164:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658492.351419:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025222784 00000100:00100000:3.0:1788658492.351429:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025222784 00000100:00100000:3.0:1788658492.351493:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788658492.351505:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025222784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658492.351540:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788658492.353140:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025222784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1631us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658492.353153:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788658492.353237:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025222784:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658492.405734:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658492.405817:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001036544 00000100:00100000:1.0:1788658492.405827:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001036544 00000100:00100000:1.0:1788658492.405889:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 172 00000100:00100000:1.0:1788658492.405901:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+48:12292:x1875544001036544:12345-192.168.202.53@tcp:36:truncate.0 00010000:00010000:1.0:1788658492.405960:0:7958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658492.405985:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc978 expref: 48 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.406005:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:1.0:1788658492.406011:0:7958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658492.406195:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.406212:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.406222:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658492.406646:0:7958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:1.0:1788658492.406669:0:7958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004891c9cc reply state 000000000ce8c4d0 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.406684:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.406757:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:1.0:1788658492.406760:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788658492.406763:0:7958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788658492.406873:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+50:12292:x1875544001036544:12345-192.168.202.53@tcp:36:truncate.0 Request processed in 973us (1148us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788658492.406883:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 172 00000020:00080000:1.0:1788658492.406889:0:7958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788658492.587230:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658492.587305:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001036672 00000100:00100000:0.0:1788658492.587313:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001036672 00000100:00100000:0.0:1788658492.587437:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 173 00000100:00100000:0.0:1788658492.587449:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+50:12306:x1875544001036672:12345-192.168.202.53@tcp:101:stat.0 00010000:00010000:0.0:1788658492.587474:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658492.587495:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f462 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc97f expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587561:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f469 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587575:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f469 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587586:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f469 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587612:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f470 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587619:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587626:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587741:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587751:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587759:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658492.587800:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788658492.587804:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658492.587821:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587833:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587841:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f469 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.587995:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f469 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588012:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f469 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588018:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658492.588023:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f469 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588031:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f469 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588041:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658492.588044:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658492.588049:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f469 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588054:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f469 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588069:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588076:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f470 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588081:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588159:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658492.588162:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588179:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f470 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588188:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1eb24baa00) 00010000:00010000:0.0:1788658492.588190:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658492.588194:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f470 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588201:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f470 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588298:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f462 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc97f expref: 52 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588313:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc97f expref: 51 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.588332:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658492.588336:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658492.588339:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671000, rc 0) 00000100:00100000:0.0:1788658492.588403:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+51:12306:x1875544001036672:12345-192.168.202.53@tcp:101:stat.0 Request processed in 957us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658492.588411:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 173 00000100:00100000:3.0:1788658492.679643:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658492.679815:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001036928 00000100:00100000:2.0:1788658492.679826:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001036928 00000100:00100000:2.0:1788658492.680017:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 174 00000100:00100000:2.0:1788658492.680028:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+51:12316:x1875544001036928:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658492.680062:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658492.680085:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f47e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc986 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658492.680188:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788658492.680330:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f47e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc986 expref: 53 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.680346:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e7ef00) 00010000:00010000:2.0:1788658492.680350:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658492.680356:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f47e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc986 expref: 53 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.680370:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0400, rc 0) 00000100:00100000:2.0:1788658492.680431:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+52:12316:x1875544001036928:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 405us (798us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1788658492.680439:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 174 00000001:00080000:1.0:1788658492.683969:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000004:00080000:1.0:1788658492.684022:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788658492.684055:0:6515:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1eb21686c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788658492.684060:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d82172100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1eb2168300 00000020:00080000:1.0:1788658492.684064:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d82431300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1d8246d800 00000020:00080000:0.0:1788658492.684304:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788658492.684369:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788658492.684381:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658492.684403:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025222912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788658492.684477:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658492.684531:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025222912 00000100:00100000:0.0:1788658492.684538:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025222912 00000100:00100000:0.0:1788658492.684584:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788658492.684608:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025222912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788658492.684640:0:13833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:0.0:1788658492.684675:0:13833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9cc33a, atime: 0x6a9cc33a, ctime: 0x6a9cc33a, blocks: 0x8 00010000:00010000:0.0:1788658492.684685:0:13833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ded7b4/0x48e67cc629c6f48c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.684721:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=409s v=(0 0) 00010000:00010000:0.0:1788658492.684727:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658492.684733:0:13833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ded7b4/0x48e67cc629c6f48c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.684750:0:13833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8ded7b4/0x48e67cc629c6f48c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.684761:0:13833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ded7b4/0x48e67cc629c6f48c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.684770:0:13833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ded7b4/0x48e67cc629c6f48c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.684790:0:13833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788658492.684909:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3650:x1875544025222912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 315us (430us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788658492.684917:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:0.0:1788658492.684952:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658492.684964:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8ded7b4/0x48e67cc629c6f48c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.684973:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658492.684978:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ded7b4/0x48e67cc629c6f48c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.684988:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ded7b4/0x48e67cc629c6f48c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.685005:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8ded7b4/0x48e67cc629c6f48c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.685013:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ded7b4/0x48e67cc629c6f48c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.685034:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658492.685036:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658492.685038:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788658492.685093:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1d836fca80/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788658492.685100:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025222912:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788658492.687519:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687537:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687545:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687569:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e80031a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658492.687575:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687582:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687598:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a1eadbbf900) 00010000:00010000:3.0:1788658492.687612:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658492.687618:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687625:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031a00/0x48e67cc629c6f2ef lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687652:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687659:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687665:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687670:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658492.687673:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687679:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687697:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658492.687699:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658492.687727:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687734:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f2f6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687751:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687758:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687765:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687771:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658492.687774:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687780:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687788:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1eb24baa00) 00010000:00010000:3.0:1788658492.687791:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658492.687794:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687801:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f335 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687828:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687834:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687841:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687847:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658492.687849:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687856:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687864:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:3.0:1788658492.687867:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658492.687870:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687876:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f438 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687886:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687891:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687898:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687908:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658492.687912:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687918:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687926:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:3.0:1788658492.687927:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658492.687930:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.687937:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6f45b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658492.691693:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658492.693387:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001037184 00000100:00100000:1.0:1788658492.693401:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001037184 00000100:00100000:1.0:1788658492.693514:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:1.0:1788658492.693526:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb57850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+17:12316:x1875544001037184:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658492.693800:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb57850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:12316:x1875544001037184:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 276us (5489us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1788658492.693808:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:3.0:1788658492.756213:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658492.757359:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001037440 00000100:00100000:1.0:1788658492.757372:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001037440 00000100:00100000:1.0:1788658492.757765:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 175 00000100:00100000:1.0:1788658492.757777:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d81b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:12322:x1875544001037440:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:1.0:1788658492.757802:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658492.757836:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f493 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc98d expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.757971:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.757989:0:7958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc97f expref: 19 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.757998:0:7958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.758032:0:7958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc97f expref: 19 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.758044:0:7958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc97f expref: 19 pid: 11974 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658492.758057:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025223040:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658492.758173:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83158000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658492.761644:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658492.761753:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001037568 00000100:00100000:3.0:1788658492.761764:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001037568 00010000:00010000:3.0:1788658492.761812:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc97f expref: 20 pid: 11974 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658492.761870:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 85 00000100:00100000:3.0:1788658492.761882:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:2397:x1875544001037568:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658492.761898:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658492.761905:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc97f expref: 20 pid: 11974 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.761919:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc97f expref: 20 pid: 11974 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.761958:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:3.0:1788658492.761964:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.761975:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.761982:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.762002:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658492.762062:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:2397:x1875544001037568:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 182us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658492.762070:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 85 00010000:00010000:1.0:1788658492.763486:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f477 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc97f expref: 19 pid: 11974 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658492.763510:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025223040:192.168.202.53@tcp:104: 00010000:00010000:1.0:1788658492.763593:0:7958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.763605:0:7958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.763837:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658492.763861:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788658492.764003:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f493 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc98d expref: 20 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.764021:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc98d expref: 19 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.764031:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:1.0:1788658492.764034:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788658492.764037:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418800, rc 0) 00000100:00100000:1.0:1788658492.764095:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d81b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:12322:x1875544001037440:12345-192.168.202.53@tcp:101:bash.0 Request processed in 6321us (7901us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788658492.764104:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 175 00000100:00100000:2.0:1788658492.771330:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658492.771447:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001037824 00000100:00100000:0.0:1788658492.771458:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001037824 00000100:00100000:0.0:1788658492.771997:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 176 00000100:00100000:0.0:1788658492.772010:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:12322:x1875544001037824:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:0.0:1788658492.774046:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.774070:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.774083:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658492.774135:0:11974:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788658492.774430:0:11974:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000143c85a9 reply state 0000000090bd3629 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.774443:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.774451:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658492.774454:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658492.774457:0:11974:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658492.774804:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:12322:x1875544001037824:12345-192.168.202.53@tcp:36:bash.0 Request processed in 2793us (3482us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788658492.774814:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 176 00000020:00080000:0.0:1788658492.774829:0:11974:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788658492.788412:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658492.788995:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001037952 00000100:00100000:2.0:1788658492.789005:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001037952 00000100:00100000:2.0:1788658492.789111:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 177 00000100:00100000:2.0:1788658492.789123:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:12322:x1875544001037952:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658492.789156:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658492.789180:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f4af lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc994 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.789315:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.789332:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc98d expref: 23 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.789343:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.789382:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc98d expref: 23 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658492.789396:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc98d expref: 23 pid: 7958 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658492.789409:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025223168:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658492.789571:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658492.795151:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658492.795807:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001038080 00000100:00100000:1.0:1788658492.795827:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001038080 00010000:00010000:1.0:1788658492.795880:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc98d expref: 24 pid: 7958 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658492.795926:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 86 00000100:00100000:1.0:1788658492.795936:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:2397:x1875544001038080:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658492.795952:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658492.795959:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc98d expref: 24 pid: 7958 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.795995:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc98d expref: 24 pid: 7958 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.796021:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:1.0:1788658492.796027:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.796038:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.796047:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658492.796068:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658492.796129:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:2397:x1875544001038080:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 193us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658492.796137:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 86 00010000:00010000:0.0:1788658492.797427:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f49a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc98d expref: 23 pid: 7958 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658492.797454:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025223168:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658492.797480:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.797506:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.797511:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658492.797570:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788658492.797575:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658492.797596:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.797629:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f4af lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc994 expref: 23 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.797645:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc994 expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.799280:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658492.799290:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658492.799307:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1000, rc 0) 00000100:00100000:0.0:1788658492.799395:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:12322:x1875544001037952:12345-192.168.202.53@tcp:101:bash.0 Request processed in 10270us (10990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658492.799404:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 177 00000100:00100000:2.0:1788658492.804829:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658492.808561:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001038336 00000100:00100000:3.0:1788658492.808693:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001038336 00000100:00100000:3.0:1788658492.808961:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:3.0:1788658492.808973:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:12322:x1875544001038336:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:3.0:1788658492.809210:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:12322:x1875544001038336:12345-192.168.202.53@tcp:35:bash.0 Request processed in 239us (4403us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788658492.809219:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00010000:00010000:3.0:1788658492.862876:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658492.906783:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658492.906915:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001038592 00000100:00100000:3.0:1788658492.906925:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001038592 00000100:00100000:3.0:1788658492.906988:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 178 00000100:00100000:3.0:1788658492.906999:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:12332:x1875544001038592:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658492.907025:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658492.907062:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f4bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc99b expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658492.907155:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788658492.907275:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f4bd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc99b expref: 25 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.907300:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e7ef00) 00010000:00010000:3.0:1788658492.907303:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658492.907309:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f4bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc99b expref: 25 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658492.907326:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96c00, rc 0) 00000100:00100000:3.0:1788658492.907387:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12332:x1875544001038592:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 389us (616us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1788658492.907395:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 178 00000100:00100000:2.0:1788658492.916899:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658492.917121:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001038720 00000100:00100000:0.0:1788658492.917132:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001038720 00000100:00100000:0.0:1788658492.917306:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 179 00000100:00100000:0.0:1788658492.917317:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12332:x1875544001038720:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:0.0:1788658492.917404:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917435:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917448:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917462:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917469:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917480:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917546:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917556:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917562:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658492.917616:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917628:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917634:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917649:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917666:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658492.917670:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917677:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917689:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658492.917692:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658492.917696:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917725:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917738:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917744:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917749:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917753:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658492.917756:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917772:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917780:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1eb24ba800) 00010000:00010000:0.0:1788658492.917783:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658492.917786:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917792:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917806:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917812:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917817:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917827:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658492.917830:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917836:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917842:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658492.917845:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658492.917848:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658492.917864:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658492.917942:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12332:x1875544001038720:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 625us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658492.917950:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 179 00000100:00100000:2.0:1788658492.921899:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658492.922051:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001038976 00000100:00100000:1.0:1788658492.922062:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001038976 00000100:00100000:1.0:1788658492.922121:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:1.0:1788658492.922131:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12332:x1875544001038976:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658492.922380:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:12332:x1875544001038976:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 250us (489us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788658492.922388:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:2.0:1788658493.011309:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658493.011477:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001039232 00000100:00100000:0.0:1788658493.011488:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001039232 00000100:00100000:0.0:1788658493.011552:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 180 00000100:00100000:0.0:1788658493.011573:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:12335:x1875544001039232:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658493.011597:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658493.011618:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9a2 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.011691:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.011757:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.011770:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.011786:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.011794:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.011817:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.011910:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f4f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.011920:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.011927:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658493.011936:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788658493.012009:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012017:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012023:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012028:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658493.012032:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012038:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012049:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658493.012052:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658493.012063:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012069:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f4e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012083:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012103:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012109:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012113:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658493.012116:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012121:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012129:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1eb24ba800) 00010000:00010000:0.0:1788658493.012131:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658493.012134:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012140:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f4ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012644:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f4e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9a2 expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012672:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9a2 expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.012680:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658493.012682:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658493.012685:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671400, rc 0) 00000100:00100000:0.0:1788658493.012820:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12335:x1875544001039232:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1249us (1519us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788658493.012828:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 180 00000100:00100000:2.0:1788658493.018442:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658493.018530:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001039360 00000100:00100000:0.0:1788658493.018539:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001039360 00000100:00100000:0.0:1788658493.018613:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:0.0:1788658493.018624:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12335:x1875544001039360:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:0.0:1788658493.018692:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f503 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.018734:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.018747:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.018784:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.018792:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f503 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.018810:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.018816:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658493.018820:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.018828:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f503 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.018840:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658493.018843:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658493.018847:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f503 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.018854:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f503 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658493.018936:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12335:x1875544001039360:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 313us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658493.018943:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 181 00000100:00100000:2.0:1788658493.022106:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.022190:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001039616 00000100:00100000:3.0:1788658493.022201:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001039616 00000100:00100000:3.0:1788658493.022256:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:3.0:1788658493.022265:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12335:x1875544001039616:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:3.0:1788658493.022491:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:12335:x1875544001039616:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 226us (393us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788658493.022499:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:2.0:1788658493.026640:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.026737:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001039744 00000100:00100000:3.0:1788658493.026748:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001039744 00000100:00100000:3.0:1788658493.026818:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:3.0:1788658493.026829:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:2398:x1875544001039744:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658493.026859:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658493.026885:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f4f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9a2 expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.026909:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:3.0:1788658493.026915:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658493.026973:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:2398:x1875544001039744:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 146us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658493.026981:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1788658493.221418:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658493.221617:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001040000 00000100:00100000:0.0:1788658493.221627:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001040000 00000100:00100000:0.0:1788658493.221886:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00100000:0.0:1788658493.221895:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12353:x1875544001040000:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:0.0:1788658493.221917:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658493.221934:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f50a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9a9 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.222067:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f511 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.222083:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f511 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.222098:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f511 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658493.222109:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788658493.222224:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f50a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9a9 expref: 30 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.222244:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f511 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9a9 expref: 29 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.222264:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658493.222267:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788658493.222271:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670c00, rc 0) 00000100:00100000:0.0:1788658493.222343:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12353:x1875544001040000:12345-192.168.202.53@tcp:101:cat.0 Request processed in 448us (932us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788658493.222351:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 182 00000100:00100000:2.0:1788658493.255768:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658493.255952:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001040128 00000100:00100000:0.0:1788658493.255962:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001040128 00000100:00100000:0.0:1788658493.256084:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 183 00000100:00100000:0.0:1788658493.256097:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12354:x1875544001040128:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658493.256124:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658493.256158:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f51f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9b0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.256228:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f526 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.256242:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.256265:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658493.256308:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788658493.256312:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658493.256330:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.256356:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f51f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b0 expref: 31 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.256374:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b0 expref: 30 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.256397:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658493.256401:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658493.256405:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670e00, rc 0) 00000100:00100000:0.0:1788658493.256469:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:12354:x1875544001040128:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 374us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658493.256477:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 183 00000100:00100000:2.0:1788658493.272982:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.273136:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001040512 00000100:00100000:3.0:1788658493.273147:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001040512 00000100:00100000:3.0:1788658493.273960:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:3.0:1788658493.273971:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:12354:x1875544001040512:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:3.0:1788658493.275315:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:12354:x1875544001040512:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 1338us (2336us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788658493.275327:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:2.0:1788658493.277346:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658493.277446:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001040640 00000100:00100000:1.0:1788658493.277457:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001040640 00000100:00100000:1.0:1788658493.277534:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:1.0:1788658493.277556:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:12354:x1875544001040640:12345-192.168.202.53@tcp:103:lfs.0 00010000:00010000:1.0:1788658493.277572:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788658493.277598:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f4b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc994 expref: 31 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.277620:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f511 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9a9 expref: 30 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.277634:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f3ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc94e expref: 29 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.277648:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:1.0:1788658493.277663:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658493.277755:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:12354:x1875544001040640:12345-192.168.202.53@tcp:103:lfs.0 Request processed in 201us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658493.277762:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1788658493.281943:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.282593:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001040768 00000100:00100000:3.0:1788658493.282605:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001040768 00000100:00100000:3.0:1788658493.282751:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 184 00000100:00100000:3.0:1788658493.282763:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:12354:x1875544001040768:12345-192.168.202.53@tcp:58:lfs.0 00010000:00010000:3.0:1788658493.282877:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f52d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.282896:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f52d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.282909:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f52d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658493.283025:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788658493.283112:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:12354:x1875544001040768:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 351us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658493.283120:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 184 00000100:00100000:2.0:1788658493.306893:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658493.307119:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001040896 00000100:00100000:0.0:1788658493.307141:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001040896 00000100:00100000:0.0:1788658493.307196:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 185 00000100:00100000:0.0:1788658493.307207:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:12356:x1875544001040896:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658493.307226:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658493.307255:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f534 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9b7 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307318:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f53b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307330:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f53b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307340:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f53b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307352:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f542 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307358:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307363:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307429:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307439:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307445:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658493.307502:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788658493.307506:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658493.307740:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307752:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307761:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f53b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307767:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f53b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307774:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f53b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307780:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658493.307784:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f53b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307790:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f53b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307798:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658493.307800:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658493.307803:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f53b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307807:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f53b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307826:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f542 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307830:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f542 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307834:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f542 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307836:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658493.307838:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f542 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307841:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f542 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307845:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1eb24ba800) 00010000:00010000:0.0:1788658493.307846:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658493.307848:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f542 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307851:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f542 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.307872:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f534 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b7 expref: 30 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.308074:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b7 expref: 29 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.308090:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658493.308092:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658493.308094:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670c00, rc 0) 00000100:00100000:0.0:1788658493.308196:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83469c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12356:x1875544001040896:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 990us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658493.308203:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 185 00000100:00100000:2.0:1788658493.634786:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.634842:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.634878:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.634906:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.634935:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001041152 00000100:00100000:2.0:1788658493.634944:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001041152 00000100:00100000:2.0:1788658493.635001:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 345 00000100:00100000:2.0:1788658493.635010:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001041152:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658493.635075:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83469500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001041152:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 66us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.635081:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 345 00000100:00100000:2.0:1788658493.635102:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001041280 00000100:00100000:2.0:1788658493.635105:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001041280 00000100:00100000:2.0:1788658493.635132:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001041408 00000100:00100000:2.0:1788658493.635134:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001041408 00000100:00100000:2.0:1788658493.635153:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:2.0:1788658493.635159:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2398:x1875544001041280:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658493.635182:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83469880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2398:x1875544001041280:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.635187:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:2.0:1788658493.635196:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:2.0:1788658493.635212:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544001041408:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658493.635246:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2398:x1875544001041408:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 44us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.635252:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00080000:2.0:1788658493.635268:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658493.635271:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788658493.635274:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658493.635539:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001041024 00000100:00100000:1.0:1788658493.635544:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001041024 00000100:00100000:1.0:1788658493.635597:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 392 00000100:00100000:1.0:1788658493.635606:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544001041024:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658493.635651:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544001041024:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 47us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658493.635657:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 392 00000100:00100000:2.0:1788658493.638401:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.638439:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658493.638513:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001041536 00000100:00100000:0.0:1788658493.638523:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001041536 00000100:00100000:0.0:1788658493.638598:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001041664 00000100:00100000:0.0:1788658493.638602:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001041664 00000100:00100000:0.0:1788658493.638622:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 346 00000100:00100000:0.0:1788658493.638630:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8346aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001041536:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658493.638691:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8346aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001041536:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 62us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658493.638698:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 346 00000100:00100000:0.0:1788658493.638738:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 347 00000100:00100000:0.0:1788658493.638745:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001041664:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658493.638771:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001041664:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658493.638777:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 347 00000100:00080000:2.0:1788658493.639046:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658493.639050:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788658493.697176:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658493.697186:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658493.697244:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788658493.697255:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788658493.697403:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025223296:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788658493.697510:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e91185b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658493.700557:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025223296:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788658493.705212:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658493.707596:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001041792 00000100:00100000:1.0:1788658493.707609:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001041792 00000100:00100000:1.0:1788658493.707674:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 186 00000100:00100000:1.0:1788658493.707685:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e98368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12367:x1875544001041792:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788658493.707761:0:7958:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788658493.707906:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e98368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12367:x1875544001041792:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 222us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658493.707915:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 186 00000100:00100000:3.0:1788658493.711677:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658493.711812:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001041920 00000100:00100000:1.0:1788658493.711831:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001041920 00000100:00100000:1.0:1788658493.711888:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 187 00000100:00100000:1.0:1788658493.711898:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebd9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12367:x1875544001041920:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788658493.711968:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f550 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.711985:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f550 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.711997:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f550 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712012:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f557 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712019:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f557 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712026:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f557 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712050:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712059:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712076:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658493.712122:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788658493.712126:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658493.712140:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712151:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f550 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712157:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f550 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712164:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f550 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712169:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658493.712173:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f550 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712179:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f550 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712190:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:1.0:1788658493.712204:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658493.712209:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f550 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712214:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f550 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712236:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f557 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712241:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f557 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712247:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f557 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712251:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658493.712253:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f557 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712258:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f557 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712265:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8a1e83b21300) 00010000:00010000:1.0:1788658493.712267:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658493.712270:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f557 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712275:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f557 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712290:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712295:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712301:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712311:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658493.712314:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712319:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712327:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:1.0:1788658493.712329:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658493.712332:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.712338:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418200/0x48e67cc629c6f55e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658493.712418:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebd9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12367:x1875544001041920:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 520us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658493.712426:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 187 00000100:00100000:3.0:1788658493.718805:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658493.718911:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001042176 00000100:00100000:1.0:1788658493.718921:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001042176 00000100:00100000:1.0:1788658493.718979:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 188 00000100:00100000:1.0:1788658493.718990:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12367:x1875544001042176:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658493.719012:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658493.719035:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c6f565 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9be expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719151:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f56c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719178:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f56c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719202:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f56c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658493.719215:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788658493.719288:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f56c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719295:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f56c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719301:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f56c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719306:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658493.719311:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f56c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719318:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f56c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719330:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:1.0:1788658493.719333:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658493.719337:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f56c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719343:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f56c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719388:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c6f565 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9be expref: 31 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719406:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:1.0:1788658493.719408:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658493.719412:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419200/0x48e67cc629c6f565 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9be expref: 31 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.719421:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419200, rc 0) 00000100:00100000:1.0:1788658493.719485:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:12367:x1875544001042176:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 496us (691us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1788658493.719497:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 188 00000100:00100000:0.0:1788658493.728007:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658493.728087:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001042304 00000100:00100000:1.0:1788658493.728097:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001042304 00000100:00100000:1.0:1788658493.728164:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 189 00000100:00100000:1.0:1788658493.728176:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:12367:x1875544001042304:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788658493.728224:0:6538:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788658493.728343:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:12367:x1875544001042304:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 169us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658493.728351:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 189 00000100:00100000:3.0:1788658493.739228:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.739457:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001042560 00000100:00100000:2.0:1788658493.739467:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001042560 00000100:00100000:2.0:1788658493.739528:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 190 00000100:00100000:2.0:1788658493.739540:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:12367:x1875544001042560:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658493.739562:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658493.739565:0:6537:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788658493.739590:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f526 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b0 expref: 30 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.739607:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:2.0:1788658493.739612:0:6537:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658493.739626:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f57a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9c5 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788658493.740115:0:6537:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788658493.740276:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f581 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.740304:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.740314:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f581 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.740371:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f57a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9c5 expref: 32 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.740389:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f581 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9c5 expref: 31 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.740397:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1d83406700) 00010000:00010000:2.0:1788658493.740399:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658493.740402:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1e00, rc 0) 00000100:00100000:2.0:1788658493.740467:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:12367:x1875544001042560:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 929us (1250us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788658493.740475:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 190 00000100:00100000:3.0:1788658493.746203:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.746284:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001042816 00000100:00100000:2.0:1788658493.746295:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001042816 00000100:00100000:2.0:1788658493.747335:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 191 00000100:00100000:2.0:1788658493.747351:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:12367:x1875544001042816:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658493.747413:0:7958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658493.747440:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f581 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9c5 expref: 31 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747456:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1d83406700) 00010000:00010000:2.0:1788658493.747484:0:7958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658493.747508:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f58f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747521:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f58f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747531:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f58f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747558:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f596 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc1761382 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747565:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1761382 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747571:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1761382 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747613:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f58f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747620:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f58f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747626:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f58f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747632:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658493.747636:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f58f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747643:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f58f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747658:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:2.0:1788658493.747661:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658493.747665:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f58f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747672:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f58f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747682:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f596 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1761382 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747687:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f596 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1761382 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747693:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f596 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1761382 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747697:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658493.747699:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f596 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1761382 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747731:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f596 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1761382 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747739:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc1761382 (ffff8a1d83406f00) 00010000:00010000:2.0:1788658493.747742:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658493.747744:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f596 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc1761382 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.747750:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f596 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc1761382 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658493.747850:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:12367:x1875544001042816:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 502us (1667us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658493.747858:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 191 00000100:00100000:2.0:1788658493.754833:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.755584:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001042944 00000100:00100000:3.0:1788658493.755594:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001042944 00000100:00100000:3.0:1788658493.755653:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:3.0:1788658493.755665:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9836ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:12367:x1875544001042944:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658493.755686:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658493.755731:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f59d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9cc expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.755768:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.755781:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.755792:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.755897:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f59d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9cc expref: 32 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.755929:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9cc expref: 31 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.755939:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:3.0:1788658493.755942:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658493.755946:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96600, rc 0) 00000100:00100000:3.0:1788658493.756005:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9836ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:12367:x1875544001042944:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 342us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658493.756013:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 192 00000100:00100000:3.0:1788658493.759301:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.760239:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001043200 00000100:00100000:2.0:1788658493.760250:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001043200 00000100:00100000:2.0:1788658493.760309:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 193 00000100:00100000:2.0:1788658493.760318:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+31:12367:x1875544001043200:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658493.760400:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.760417:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.760429:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658493.762021:0:6536:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788658493.762042:0:6536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410978338785ns, next at 411978335873ns, rc = 0 00000004:00010000:2.0:1788658493.762559:0:6536:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd02708b reply state 000000001b1bc933 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.762582:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.762596:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:2.0:1788658493.762599:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788658493.762604:0:6536:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658493.762766:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d831bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+33:12367:x1875544001043200:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 2444us (3468us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788658493.762775:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 193 00000100:00100000:2.0:1788658493.766430:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.766484:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001043328 00000100:00100000:2.0:1788658493.766494:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001043328 00000100:00100000:2.0:1788658493.766547:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 194 00000100:00100000:2.0:1788658493.766557:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+33:12367:x1875544001043328:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658493.766582:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658493.766602:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f5b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9d3 expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.766656:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f5b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9d3 expref: 34 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.766672:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f5b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9d3 expref: 34 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.766691:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:2.0:1788658493.766694:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658493.766698:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1e00, rc 0) 00000100:00100000:2.0:1788658493.766778:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+34:12367:x1875544001043328:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 221us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.766786:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 194 00000100:00100000:3.0:1788658493.772862:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658493.775568:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001043456 00000100:00100000:1.0:1788658493.775580:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001043456 00000100:00100000:1.0:1788658493.775643:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:1.0:1788658493.775652:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+6:2397:x1875544001043456:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788658493.775906:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001043456:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 253us (3055us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788658493.775914:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:2.0:1788658493.783654:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.783794:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001043712 00000100:00100000:3.0:1788658493.783806:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001043712 00000100:00100000:3.0:1788658493.783856:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:3.0:1788658493.783866:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+34:12367:x1875544001043712:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788658493.784092:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:12367:x1875544001043712:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 226us (447us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1788658493.784100:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:3.0:1788658493.789591:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658493.789697:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001043968 00000100:00100000:0.0:1788658493.789735:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001043968 00000100:00100000:0.0:1788658493.789800:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 195 00000100:00100000:0.0:1788658493.789812:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d832e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:12367:x1875544001043968:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788658493.794951:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d832e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:12367:x1875544001043968:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 5126us (5357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658493.794969:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 195 00000100:00100000:1.0:1788658493.809321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.809408:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001044096 00000100:00100000:2.0:1788658493.809419:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001044096 00000100:00100000:2.0:1788658493.809503:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 196 00000100:00100000:2.0:1788658493.809526:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:12367:x1875544001044096:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658493.809552:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658493.809578:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f5b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9da expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.809674:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f5c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.809691:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.809737:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658493.809784:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658493.809805:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.809831:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f5b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9da expref: 37 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.809848:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9da expref: 36 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.809857:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:2.0:1788658493.809860:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788658493.809864:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1600, rc 0) 00000100:00100000:2.0:1788658493.809927:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+36:12367:x1875544001044096:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 405us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.809944:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 196 00000100:00100000:0.0:1788658493.817032:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658493.819675:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001044224 00000100:00100000:1.0:1788658493.819688:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001044224 00000100:00100000:2.0:1788658493.819839:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:2.0:1788658493.819851:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2396:x1875544001044224:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658493.819871:0:13833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658493.819895:0:13833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c6f5c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9e1 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658493.819923:0:13833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc33d, blocks: 0x0 00010000:00010000:2.0:1788658493.819948:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=411s v=(0 0) 00010000:00010000:2.0:1788658493.819953:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658493.819963:0:13833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c6f5c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e1 expref: 8 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.819985:0:13833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c6f5c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e1 expref: 8 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.819998:0:13833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1400, rc 0) 00000100:00100000:2.0:1788658493.820063:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001044224:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 214us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.820071:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:3.0:1788658493.832535:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.832614:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001044480 00000100:00100000:2.0:1788658493.832627:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001044480 00000100:00100000:2.0:1788658493.832689:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 197 00000100:00100000:2.0:1788658493.832700:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+36:12367:x1875544001044480:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788658493.832858:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+36:12367:x1875544001044480:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 159us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.832866:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 197 00000100:00100000:1.0:1788658493.835796:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658493.835883:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001044608 00000100:00100000:0.0:1788658493.835893:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001044608 00000100:00100000:0.0:1788658493.835951:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:0.0:1788658493.835962:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:12367:x1875544001044608:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658493.835979:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658493.836000:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9e8 expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.836034:0:8454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c6f5c7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e1 expref: 9 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.836045:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658493.836049:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658493.836056:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 9 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.836114:0:8454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c6f5c7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e1 expref: 9 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.836129:0:8454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c6f5c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e1 expref: 9 pid: 13833 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658493.836142:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8454:1875544025223424:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658493.836240:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e91185900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658493.844727:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.844764:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001044736 00000100:00100000:3.0:1788658493.844775:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001044736 00010000:00010000:3.0:1788658493.844818:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c6f5c7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e1 expref: 10 pid: 13833 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658493.844880:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 87 00000100:00100000:3.0:1788658493.844890:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:2396:x1875544001044736:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658493.844905:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658493.844928:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c6f5c7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e1 expref: 10 pid: 13833 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.844943:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c6f5c7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e1 expref: 10 pid: 13833 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.844968:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658493.844973:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658493.844982:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 10 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.844992:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 10 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.845031:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 10 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658493.845045:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d3b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6521:1875544025223552:192.168.202.53@tcp:105: 00000100:00100000:3.0:1788658493.845141:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2168240 going to sleep for 11 seconds 00010000:00010000:0.0:1788658493.845417:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc93ed7d/0x48e67cc629c6f5c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e1 expref: 10 pid: 13833 timeout: 511 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658493.845432:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8454:1875544025223424:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658493.845458:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 9 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.845476:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670600, rc 0) 00000100:00100000:0.0:1788658493.845521:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:12367:x1875544001044608:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 9561us (9733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658493.845529:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:1.0:1788658493.849678:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d3b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6521:1875544025223552:192.168.202.53@tcp:105: 00010000:00010000:1.0:1788658493.849733:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658493.849784:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001044736:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 4895us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658493.849795:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 87 00000100:00100000:1.0:1788658493.863652:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.865662:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001044864 00000100:00100000:2.0:1788658493.865679:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001044864 00002000:00100000:2.0:1788658493.866203:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8a1e84430700 x1875544001044864/t0(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:84/0 lens 504/0 e 0 to 0 dl 1788658504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788658493.866215:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1e84430700 with x1875544001044864 ext(0->8) 00002000:00010000:2.0:1788658493.866222:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1e84430700 00000100:00100000:2.0:1788658493.866312:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1788658493.866324:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2399:x1875544001044864:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788658493.867669:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:2399:x1875544001044864:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 Request processed in 1341us (4021us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788658493.867683:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00002000:00100000:1.0:1788658493.867692:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8a1e84430700 x1875544001044864/t4294967315(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:84/0 lens 504/448 e 0 to 0 dl 1788658504 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788658493.867729:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1e84430700 with x1875544001044864 ext(0->8) 00002000:00010000:1.0:1788658493.867735:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1e84430700 00000100:00100000:3.0:1788658493.871556:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.871630:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001044992 00000100:00100000:2.0:1788658493.871639:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001044992 00000100:00100000:2.0:1788658493.871699:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 198 00000100:00100000:2.0:1788658493.871748:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+36:12367:x1875544001044992:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788658493.878980:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1788658493.879001:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00010000:00010000:2.0:1788658493.879011:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879025:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879034:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879041:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658493.879046:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788658493.879051:0:6515:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:2.0:1788658493.879072:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879094:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:2.0:1788658493.879099:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658493.879105:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879113:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f4a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879136:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879144:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879151:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879157:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658493.879160:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879167:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879185:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:2.0:1788658493.879189:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788658493.879193:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.879210:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f5ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658493.879372:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:12367:x1875544001044992:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 7621us (7820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.879383:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 198 00000020:00080000:3.0:1788658493.879446:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788658493.879463:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788658493.879639:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658493.881230:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025223680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788658493.881299:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658493.881464:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025223680 00000100:00100000:2.0:1788658493.881473:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025223680 00000100:00080000:0.0:1788658493.881529:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658493.881567:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658493.881576:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025223680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788658493.881727:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788658493.881731:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788658493 00002000:00010000:2.0:1788658493.881734:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788658493.881737:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788658493 -> 1788658493 00002000:00010000:2.0:1788658493.881739:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788658493.881791:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025223680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (490us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788658493.881798:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:1.0:1788658493.881879:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1eb7403b80/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788658493.881886:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025223680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788658493.889570:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.889899:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001045120 00000100:00100000:3.0:1788658493.889909:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001045120 00000100:00100000:3.0:1788658493.889965:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:3.0:1788658493.889976:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:2396:x1875544001045120:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788658493.890489:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788658493.895632:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1788658493.895674:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788658493.896323:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2396:x1875544001045120:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 6341us (6755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658493.896335:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:0.0:1788658493.903673:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.903733:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001045376 00000100:00100000:3.0:1788658493.903745:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001045376 00000100:00100000:3.0:1788658493.903908:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 199 00000100:00100000:3.0:1788658493.903920:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:12367:x1875544001045376:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658493.903972:0:7958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658493.903998:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f5c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9da expref: 19 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.904016:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:3.0:1788658493.904022:0:7958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658493.904051:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.904064:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.904073:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658493.904231:0:7958:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d20a4d4f reply state 000000004e9bc504 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.904245:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.904253:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:3.0:1788658493.904256:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788658493.904259:0:7958:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658493.904370:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:12367:x1875544001045376:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 451us (706us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788658493.904391:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 199 00000100:00100000:1.0:1788658493.912590:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658493.912740:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001045504 00000100:00100000:0.0:1788658493.912750:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001045504 00000100:00100000:0.0:1788658493.912813:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:0.0:1788658493.912965:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001045504:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788658493.913207:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788658493.913211:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788658493 -> 1788658492 00002000:00010000:1.0:1788658493.913214:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788658490 00002000:00010000:1.0:1788658493.913216:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788658493 -> 1788658492 00002000:00010000:1.0:1788658493.913232:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788658493.913306:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2397:x1875544001045504:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 483us (725us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788658493.913316:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:1.0:1788658493.925133:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.925263:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001045760 00000100:00100000:3.0:1788658493.925274:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001045760 00000100:00100000:3.0:1788658493.925339:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:3.0:1788658493.925350:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:12367:x1875544001045760:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788658493.925428:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.925445:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9cc expref: 20 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.925456:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.925492:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9cc expref: 20 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.925523:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9cc expref: 20 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658493.925538:0:6538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875544025223808:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658493.925662:0:6538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2168c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658493.929555:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.929653:0:6538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6538:1875544025223808:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658493.929682:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658493.929969:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001045888 00000100:00100000:1.0:1788658493.929976:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001045888 00010000:00010000:1.0:1788658493.930013:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9cc expref: 21 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658493.930568:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 88 00000100:00100000:1.0:1788658493.930579:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:2396:x1875544001045888:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658493.930595:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658493.930602:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9cc expref: 21 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.930614:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9cc expref: 21 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.930638:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9cc expref: 21 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.930653:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:1.0:1788658493.930658:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.930670:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.930688:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.930746:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658493.930797:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:2396:x1875544001045888:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 219us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658493.930805:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 88 00010000:00010000:0.0:1788658493.934398:0:6538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.934419:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.934466:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.934474:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.934481:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.934488:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658493.934492:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.934518:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.934536:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:0.0:1788658493.934540:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788658493.934554:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.934562:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f5dc lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658493.934661:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:12367:x1875544001045760:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 Request processed in 9308us (9534us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788658493.934671:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 200 00000100:00100000:1.0:1788658493.939074:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.939151:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001046016 00000100:00100000:3.0:1788658493.939161:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001046016 00000100:00100000:3.0:1788658493.939227:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:3.0:1788658493.939237:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2397:x1875544001046016:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788658493.939280:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.939300:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.939310:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658493.939314:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658493.939320:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.939355:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 8 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.939379:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 8 pid: 8454 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658493.939395:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1875544025223936:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658493.939479:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658493.954342:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658493.954452:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001046144 00000100:00100000:1.0:1788658493.954461:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001046144 00010000:00010000:1.0:1788658493.954521:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 9 pid: 8454 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658493.954559:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 89 00000100:00100000:1.0:1788658493.954569:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae3bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2396:x1875544001046144:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658493.954584:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658493.954607:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 9 pid: 8454 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.954623:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 9 pid: 8454 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.954649:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658493.954654:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658493.954660:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.954679:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658493.954725:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658493.954774:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae3bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2396:x1875544001046144:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 206us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658493.954782:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 89 00010000:00010000:3.0:1788658493.955204:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f1cff9a/0x48e67cc629c6f5ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9e8 expref: 8 pid: 8454 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658493.955219:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8453:1875544025223936:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658493.955239:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.955250:0:8453:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.955257:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.955279:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.955288:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.955310:0:8453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.955317:0:8453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658493.955321:0:8453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.955329:0:8453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.955340:0:8453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.955348:0:8453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f5e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658493.955418:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001046016:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 16182us (16373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658493.955426:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:1.0:1788658493.960967:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.961076:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001046400 00000100:00100000:3.0:1788658493.961085:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001046400 00000100:00100000:3.0:1788658493.961197:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 201 00000100:00100000:3.0:1788658493.961208:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:12367:x1875544001046400:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788658493.961288:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.961314:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc971 expref: 19 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.961325:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.961358:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc971 expref: 19 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.961372:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc971 expref: 19 pid: 7958 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658493.961388:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025224064:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658493.961480:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3482540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658493.965074:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.965201:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025224064:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658493.965229:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658493.965275:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001046528 00000100:00100000:2.0:1788658493.965282:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001046528 00010000:00010000:2.0:1788658493.965316:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc971 expref: 20 pid: 7958 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658493.965393:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 90 00000100:00100000:2.0:1788658493.965402:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:2397:x1875544001046528:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658493.965425:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658493.965431:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc971 expref: 20 pid: 7958 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.965444:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc971 expref: 20 pid: 7958 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.965464:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f431 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc971 expref: 20 pid: 7958 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.965477:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:2.0:1788658493.965482:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.965492:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.965581:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.965608:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658493.965660:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:2397:x1875544001046528:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 257us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.965668:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 90 00010000:00010000:3.0:1788658493.965728:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.965735:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.965898:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.965910:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f5b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9d3 expref: 19 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.965924:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.965952:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f5b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9d3 expref: 19 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.965965:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f5b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9d3 expref: 19 pid: 7958 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658493.965978:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025224192:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658493.966025:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658493.975353:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658493.975390:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001046656 00000100:00100000:2.0:1788658493.975399:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001046656 00010000:00010000:2.0:1788658493.975439:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f5b2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9d3 expref: 20 pid: 7958 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658493.975490:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 91 00000100:00100000:2.0:1788658493.975677:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:2397:x1875544001046656:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658493.975692:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658493.975699:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f5b2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9d3 expref: 20 pid: 7958 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658493.975862:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025224192:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658493.975884:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.975946:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f5b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9d3 expref: 20 pid: 7958 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.975969:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f5b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9d3 expref: 20 pid: 7958 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.975982:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:2.0:1788658493.975987:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.975996:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.976004:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658493.976027:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658493.976099:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:2397:x1875544001046656:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 599us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.976106:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 91 00010000:00010000:0.0:1788658493.976152:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.976159:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658493.976274:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1788658493.976385:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1788658493.976422:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1788658493.976514:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875544025224320:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788658493.976565:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658493.976600:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3482540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658493.976737:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025224320 00000100:00100000:2.0:1788658493.976749:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025224320 00000100:00100000:2.0:1788658493.976782:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788658493.976790:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1875544025224320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788658493.976854:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1875544025224320:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658493.976860:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788658493.976995:0:6537:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1788658493.977001:0:6537:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1eb7403b80, transno 4294967316 00000100:00100000:0.0:1788658493.977022:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875544025224320:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788658493.977121:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1788658493.977159:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875544025224448:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788658493.977205:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658493.977222:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e91185840 going to sleep for 11 seconds 00000100:00100000:0.0:1788658493.977235:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025224448 00000100:00100000:0.0:1788658493.977239:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025224448 00000100:00100000:0.0:1788658493.977261:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788658493.977267:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6537:x1875544025224448:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788658493.977357:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6537:x1875544025224448:12345-0@lo:1000:mdt00_001.0 Request processed in 90us (151us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788658493.977365:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788658493.977394:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6537:1875544025224448:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788658493.977421:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977430:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977438:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977445:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658493.977450:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977457:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977472:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:0.0:1788658493.977475:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658493.977481:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977767:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f5f1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977794:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f52d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977799:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f52d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977804:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f52d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977809:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658493.977812:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f52d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977818:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f52d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977827:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658493.977830:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658493.977833:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f52d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977838:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f52d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977859:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977871:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b7 expref: 22 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977887:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977911:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b7 expref: 22 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.977923:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b7 expref: 22 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658493.977933:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025224576:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658493.977980:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658493.983907:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d836cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025224576:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658493.983938:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658493.984351:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658493.984669:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001046784 00000100:00100000:3.0:1788658493.984676:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001046784 00010000:00010000:3.0:1788658493.984794:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b7 expref: 23 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658493.984832:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 92 00000100:00100000:3.0:1788658493.984842:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:2397:x1875544001046784:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658493.984854:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658493.984861:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b7 expref: 23 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.984873:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b7 expref: 23 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.984894:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f549 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9b7 expref: 23 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.984920:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:3.0:1788658493.984925:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.984934:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.984942:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658493.985004:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658493.985055:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:2397:x1875544001046784:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 214us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658493.985062:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 92 00010000:00010000:0.0:1788658493.986971:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.986988:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987004:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987011:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987018:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987033:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658493.987038:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987046:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987063:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658493.987066:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658493.987071:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987078:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f5f8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987092:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987098:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987104:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987109:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658493.987112:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987119:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987137:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e90e7e200) 00010000:00010000:0.0:1788658493.987139:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658493.987142:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658493.987147:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f5ea lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658493.987350:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:12367:x1875544001046400:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 26140us (26389us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788658493.987361:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 201 00000020:00080000:0.0:1788658493.987366:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788658493.987694:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788658493.987699:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788658493.988217:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788658493.988226:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788658494.004113:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.005130:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001047040 00000100:00100000:3.0:1788658494.005141:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001047040 00000100:00100000:3.0:1788658494.005222:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:3.0:1788658494.005233:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:12367:x1875544001047040:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00080000:0.0:1788658494.005670:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788658494.005918:0:13563:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788658494.005953:0:13563:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788658494.005990:0:13563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.006008:0:13563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.006030:0:13563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.006040:0:13563:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.006047:0:13563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.006054:0:13563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.006075:0:13563:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788658494.006174:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:12367:x1875544001047040:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 929us (2058us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788658494.006183:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000020:00080000:3.0:1788658494.006189:0:13563:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788658494.006381:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658494.006388:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.006396:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658494.006401:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.006409:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.006421:0:7486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:0.0:1788658494.006424:0:7486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788658494.006429:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.006453:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f5ff lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.006467:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658494.006469:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658494.006470:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658494.060555:0:14673:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658494.060562:0:14673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658494.060581:0:14673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788658494.060587:0:14673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788658494.224106:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.224225:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001047296 00000100:00100000:3.0:1788658494.224236:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001047296 00000100:00100000:3.0:1788658494.224312:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:3.0:1788658494.224324:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:12377:x1875544001047296:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658494.224351:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658494.224372:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f606 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9ef expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.224503:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f60d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.224521:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f60d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.224549:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f60d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658494.224563:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788658494.224669:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f606 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9ef expref: 26 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.224689:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f60d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9ef expref: 25 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.224698:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658494.224721:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788658494.224725:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97800, rc 0) 00000100:00100000:3.0:1788658494.224782:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:12377:x1875544001047296:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 459us (685us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788658494.224789:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 202 00000100:00100000:0.0:1788658494.235384:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658494.235520:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001047424 00000100:00100000:1.0:1788658494.235531:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001047424 00000100:00100000:1.0:1788658494.235603:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 203 00000100:00100000:1.0:1788658494.235615:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d836cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:12377:x1875544001047424:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:1.0:1788658494.235724:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6f61b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235741:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6f61b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235754:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6f61b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235769:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f622 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235777:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235801:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235879:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235887:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235894:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788658494.235940:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235953:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6f61b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235960:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6f61b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235979:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6f61b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235984:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658494.235989:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6f61b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.235997:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6f61b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236009:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:1.0:1788658494.236018:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658494.236024:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6f61b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236030:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418c00/0x48e67cc629c6f61b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236042:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236047:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f622 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236052:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236056:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658494.236058:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236063:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236071:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e83b21300) 00010000:00010000:1.0:1788658494.236073:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658494.236076:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f622 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236082:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f622 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236098:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236109:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236115:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236121:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658494.236124:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236129:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236146:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:1.0:1788658494.236148:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658494.236151:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.236156:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418600/0x48e67cc629c6f629 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658494.236229:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d836cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:12377:x1875544001047424:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 616us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658494.236237:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 203 00000100:00100000:0.0:1788658494.285578:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658494.285663:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001047680 00000100:00100000:2.0:1788658494.285674:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001047680 00000100:00100000:2.0:1788658494.285834:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 204 00000100:00100000:2.0:1788658494.285846:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+25:12380:x1875544001047680:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658494.285869:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658494.285892:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f630 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9f6 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.285978:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f637 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.285992:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286005:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286021:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f63e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286043:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f63e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286051:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f63e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286181:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286190:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286197:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658494.286208:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788658494.286292:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286300:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f637 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286307:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f637 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286313:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658494.286317:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f637 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286325:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f637 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286348:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:2.0:1788658494.286351:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658494.286356:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f637 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286364:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f637 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286391:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f63e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286399:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f63e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286405:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f63e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286410:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658494.286413:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f63e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286420:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f63e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286429:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1d83406900) 00010000:00010000:2.0:1788658494.286431:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658494.286434:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f63e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286441:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f63e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286496:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f630 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9f6 expref: 28 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286510:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9f6 expref: 27 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.286518:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:2.0:1788658494.286520:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658494.286522:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1e00, rc 0) 00000100:00100000:2.0:1788658494.286593:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12380:x1875544001047680:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 748us (1024us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788658494.286600:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 204 00000100:00100000:1.0:1788658494.292565:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.292730:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001047808 00000100:00100000:3.0:1788658494.292740:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001047808 00000100:00100000:3.0:1788658494.292804:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 205 00000100:00100000:3.0:1788658494.292815:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12380:x1875544001047808:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:3.0:1788658494.292890:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f653 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.292908:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.292922:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.292992:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.293000:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f653 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.293006:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.293013:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658494.293017:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.293025:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f653 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.293037:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:3.0:1788658494.293040:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658494.293045:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f653 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.293051:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f653 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658494.293138:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12380:x1875544001047808:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 315us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.293146:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 205 00000100:00100000:0.0:1788658494.299447:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658494.299526:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001048064 00000100:00100000:2.0:1788658494.299537:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001048064 00000100:00100000:2.0:1788658494.299593:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:2.0:1788658494.299604:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12380:x1875544001048064:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1788658494.299859:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:12380:x1875544001048064:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 257us (421us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1788658494.299867:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:3.0:1788658494.340911:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658494.341357:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001048320 00000100:00100000:0.0:1788658494.341368:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001048320 00000100:00100000:0.0:1788658494.341596:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 206 00000100:00100000:0.0:1788658494.341608:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:11913:x1875544001048320:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658494.341632:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658494.341654:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f65a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcc9fd expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.342793:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.342815:0:11974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9f6 expref: 29 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.342842:0:11974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.342878:0:11974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9f6 expref: 29 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.342892:0:11974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9f6 expref: 29 pid: 6537 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658494.342905:0:11974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d52300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025224704:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658494.343067:0:11974:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83158180 going to sleep for 11 seconds 00000100:00100000:2.0:1788658494.348000:0:11974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d52300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11974:1875544025224704:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658494.348029:0:11974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658494.348749:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658494.348806:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001048448 00000100:00100000:2.0:1788658494.348814:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001048448 00010000:00010000:2.0:1788658494.348864:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9f6 expref: 30 pid: 6537 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658494.348911:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 93 00000100:00100000:2.0:1788658494.348923:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:2397:x1875544001048448:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658494.348938:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658494.348944:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9f6 expref: 30 pid: 6537 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.348953:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9f6 expref: 30 pid: 6537 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.348970:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f645 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9f6 expref: 30 pid: 6537 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.348981:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:2.0:1788658494.348986:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.348996:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.349003:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.349034:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658494.349081:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:2397:x1875544001048448:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 161us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658494.349086:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 93 00010000:00010000:1.0:1788658494.349191:0:11974:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.349200:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658494.349220:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788658494.349345:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f65a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9fd expref: 30 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.349361:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9fd expref: 29 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.349369:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:1.0:1788658494.349372:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788658494.349381:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419800, rc 0) 00000100:00100000:1.0:1788658494.349405:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:11913:x1875544001048320:12345-192.168.202.53@tcp:101:bash.0 Request processed in 7801us (8505us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788658494.349412:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 206 00000100:00100000:0.0:1788658494.355242:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.355830:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001048576 00000100:00100000:3.0:1788658494.355840:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001048576 00000100:00100000:3.0:1788658494.356177:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 207 00000100:00100000:3.0:1788658494.356189:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:11913:x1875544001048576:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1788658494.356213:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658494.356235:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f66f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca04 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.356266:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f676 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.356280:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.356291:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.356390:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c6f66f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca04 expref: 31 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.356422:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca04 expref: 30 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.356432:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:3.0:1788658494.356435:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658494.356438:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96e00, rc 0) 00000100:00100000:3.0:1788658494.356515:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11913:x1875544001048576:12345-192.168.202.53@tcp:101:bash.0 Request processed in 329us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.356522:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 207 00000100:00100000:3.0:1788658494.368396:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658494.369251:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001048832 00000100:00100000:0.0:1788658494.369266:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001048832 00000100:00100000:0.0:1788658494.369377:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 208 00000100:00100000:0.0:1788658494.369388:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:11913:x1875544001048832:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:0.0:1788658494.369661:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.369679:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.369743:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658494.369787:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1788658494.369810:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001853650d reply state 00000000cafd942a transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.369823:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.369831:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:0.0:1788658494.369834:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658494.369838:0:6537:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788658494.369878:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1788658494.369994:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+34:11913:x1875544001048832:12345-192.168.202.53@tcp:36:bash.0 Request processed in 596us (1595us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788658494.370002:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 208 00000020:00080000:0.0:1788658494.370007:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788658494.376188:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658494.376358:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001048960 00000100:00100000:2.0:1788658494.376368:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001048960 00000100:00100000:2.0:1788658494.376432:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 209 00000100:00100000:2.0:1788658494.376444:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+34:11913:x1875544001048960:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658494.376469:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658494.376491:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f684 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca0b expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.376548:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f684 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca0b expref: 35 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.376574:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f684 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca0b expref: 35 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658494.376596:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:2.0:1788658494.376599:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658494.376604:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1e00, rc 0) 00000100:00100000:2.0:1788658494.376907:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:11913:x1875544001048960:12345-192.168.202.53@tcp:101:bash.0 Request processed in 465us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658494.376915:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 209 00000100:00100000:1.0:1788658494.387251:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.387423:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001049088 00000100:00100000:3.0:1788658494.387450:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001049088 00000100:00100000:3.0:1788658494.387515:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:3.0:1788658494.387526:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:11913:x1875544001049088:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1788658494.387545:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658494.387806:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1a21b3b/0x48e67cc629c6f68b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca12 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658494.387837:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9cc33c, atime: 0x6a9cc33a, ctime: 0x6a9cc33c, blocks: 0x8 00010000:00010000:3.0:1788658494.387860:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=411s v=(0 0) 00010000:00010000:3.0:1788658494.387865:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658494.387874:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a21b3b/0x48e67cc629c6f68b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca12 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.387892:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1a21b3b/0x48e67cc629c6f68b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca12 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.387903:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96200, rc 0) 00000100:00100000:3.0:1788658494.388924:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:11913:x1875544001049088:12345-192.168.202.53@tcp:101:bash.0 Request processed in 1394us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.388932:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:3.0:1788658494.396242:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658494.396433:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001049216 00000100:00100000:2.0:1788658494.396443:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001049216 00002000:00010000:2.0:1788658494.396488:0:8458:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1788658494.396493:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d834e5880 with x1875544001049216 ext(0->18446744073709551615) 00002000:00010000:2.0:1788658494.396505:0:8458:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1d834e5880. 00000100:00100000:2.0:1788658494.396541:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1788658494.396561:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001049216:12345-192.168.202.53@tcp:10:bash.0 00002000:00010000:2.0:1788658494.397202:0:8458:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788658494.397206:0:8458:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788658492 -> 1788658493 00002000:00010000:2.0:1788658494.397209:0:8458:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788658490 -> 1788658490 00002000:00010000:2.0:1788658494.397211:0:8458:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788658492 -> 1788658493 00002000:00010000:2.0:1788658494.397213:0:8458:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788658494.397265:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2396:x1875544001049216:12345-192.168.202.53@tcp:10:bash.0 Request processed in 715us (1033us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788658494.397273:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00002000:00010000:2.0:1788658494.397277:0:8458:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1788658494.397279:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d834e5880 with x1875544001049216 ext(0->18446744073709551615) 00002000:00010000:2.0:1788658494.397284:0:8458:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1d834e5880. 00000100:00100000:1.0:1788658494.513057:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.514818:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001049344 00000100:00100000:3.0:1788658494.514830:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001049344 00000100:00100000:3.0:1788658494.514899:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 210 00000100:00100000:3.0:1788658494.514907:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:12394:x1875544001049344:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:3.0:1788658494.517220:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f692 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517273:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f692 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517287:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f692 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517310:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f699 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517317:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517322:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517417:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517427:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517433:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658494.517485:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517497:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f692 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517503:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f692 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517521:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f692 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517526:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658494.517531:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f692 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517541:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f692 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517553:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658494.517558:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658494.517561:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f692 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517568:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517585:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f699 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517591:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f699 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517597:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517602:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658494.517604:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f699 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517622:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f699 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517630:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658494.517632:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658494.517635:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f699 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517640:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f699 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517654:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517660:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517665:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517670:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658494.517673:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517679:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517685:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:3.0:1788658494.517688:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658494.517691:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.517764:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658494.517872:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:12394:x1875544001049344:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 2959us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.517882:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 210 00000100:00100000:1.0:1788658494.572420:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658494.572535:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001049600 00000100:00100000:0.0:1788658494.572546:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001049600 00000100:00100000:0.0:1788658494.572622:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 211 00000100:00100000:0.0:1788658494.572633:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+35:12397:x1875544001049600:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658494.572653:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658494.572684:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca19 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.572782:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f6ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.572815:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f6ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.572827:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f6ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.572843:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.572850:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.572857:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.572987:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f6bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.572997:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f6bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573004:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f6bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658494.573014:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788658494.573086:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f6ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573102:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f6ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573109:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f6ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573121:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658494.573126:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f6ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573134:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f6ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573146:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658494.573149:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658494.573154:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f6ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573160:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f6ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573174:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573181:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573187:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573192:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658494.573194:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573200:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573217:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e90e70300) 00010000:00010000:0.0:1788658494.573219:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658494.573222:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573229:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573274:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca19 expref: 38 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573289:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f6bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca19 expref: 37 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.573297:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:0.0:1788658494.573301:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788658494.573303:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671000, rc 0) 00000100:00100000:0.0:1788658494.573562:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+37:12397:x1875544001049600:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 930us (1153us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788658494.573570:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 211 00000100:00100000:2.0:1788658494.578186:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658494.578466:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001049728 00000100:00100000:0.0:1788658494.578478:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001049728 00000100:00100000:0.0:1788658494.578534:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 212 00000100:00100000:0.0:1788658494.578545:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+37:12397:x1875544001049728:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:0.0:1788658494.578607:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.578625:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9fd expref: 37 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.578646:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.578690:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9fd expref: 37 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.578738:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9fd expref: 37 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658494.578752:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025224832:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658494.578854:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658494.581942:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.582195:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001049984 00000100:00100000:3.0:1788658494.582205:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001049984 00000100:00100000:3.0:1788658494.582263:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:3.0:1788658494.582274:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:6169:x1875544001049984:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788658494.582767:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6537:1875544025224832:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658494.582794:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658494.583197:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:6169:x1875544001049984:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 923us (1262us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788658494.583206:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:1.0:1788658494.589486:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.589582:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001050112 00000100:00100000:3.0:1788658494.589592:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001050112 00010000:00010000:3.0:1788658494.589634:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9fd expref: 39 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658494.589688:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 94 00000100:00100000:3.0:1788658494.589698:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:2397:x1875544001050112:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658494.589750:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658494.589758:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9fd expref: 39 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.589772:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9fd expref: 39 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.589794:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f661 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9fd expref: 39 pid: 11974 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.589829:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:3.0:1788658494.589835:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.589844:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.589852:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.589875:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658494.589933:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:2397:x1875544001050112:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 236us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.589941:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 94 00010000:00010000:0.0:1788658494.590180:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.590193:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.590235:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.590243:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.590250:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.590262:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658494.590266:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.590273:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.590282:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:0.0:1788658494.590285:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658494.590289:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.590294:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f6ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658494.590441:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+37:12397:x1875544001049728:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 11897us (12263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658494.590449:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 212 00000100:00100000:1.0:1788658494.600115:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658494.600204:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001050368 00000100:00100000:2.0:1788658494.600213:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001050368 00000100:00100000:2.0:1788658494.600271:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:2.0:1788658494.600281:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+37:12397:x1875544001050368:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1788658494.600489:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:12397:x1875544001050368:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 209us (384us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788658494.600496:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:2.0:1788658494.723903:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.724010:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001050624 00000100:00100000:3.0:1788658494.724019:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001050624 00000100:00100000:3.0:1788658494.724069:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 213 00000100:00100000:3.0:1788658494.724086:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+38:12408:x1875544001050624:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:3.0:1788658494.724116:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658494.724140:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca20 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724218:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f6d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724235:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f6d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724248:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f6d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724279:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f6df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724287:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724294:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724589:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f6e6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724600:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724606:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f6e6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658494.724616:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788658494.724691:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f6d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724699:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f6d8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724982:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.724989:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658494.724993:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f6d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725012:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f6d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725025:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658494.725028:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658494.725033:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f6d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725040:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f6d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725058:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725064:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f6df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725069:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f6df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725074:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658494.725087:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f6df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725093:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f6df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725099:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658494.725102:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658494.725104:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f6df lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725120:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f6df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725167:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f6d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca20 expref: 41 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725182:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f6e6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca20 expref: 40 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.725189:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:3.0:1788658494.725192:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658494.725195:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96c00, rc 0) 00000100:00100000:3.0:1788658494.725312:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+40:12408:x1875544001050624:12345-192.168.202.53@tcp:101:cat.0 Request processed in 1234us (1419us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788658494.725319:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 213 00000100:00100000:0.0:1788658494.730543:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658494.730580:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001050880 00000100:00100000:2.0:1788658494.730590:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001050880 00000100:00100000:2.0:1788658494.731146:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:2.0:1788658494.731159:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+40:12408:x1875544001050880:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:2.0:1788658494.731440:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+41:12408:x1875544001050880:12345-192.168.202.53@tcp:35:cat.0 Request processed in 283us (905us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788658494.731449:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:1.0:1788658494.751526:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658494.751753:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001051136 00000100:00100000:0.0:1788658494.751762:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001051136 00000100:00100000:0.0:1788658494.751815:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 214 00000100:00100000:0.0:1788658494.751825:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+41:12409:x1875544001051136:12345-192.168.202.53@tcp:36:rm.0 00010000:00010000:0.0:1788658494.751891:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788658494.751917:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f684 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca0b expref: 41 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752044:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f6e6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca20 expref: 40 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752104:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f6bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca19 expref: 39 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752183:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca04 expref: 38 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752194:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:0.0:1788658494.752199:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658494.752222:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752236:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752245:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752258:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752265:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752271:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752831:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f702 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752842:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f702 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.752861:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f702 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658494.753185:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:0.0:1788658494.753232:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753243:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753250:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753258:0:6538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753265:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753273:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753294:0:6538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658494.753318:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f702 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753326:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f702 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753333:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f702 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.753335:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658494.753343:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753358:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658494.753362:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f702 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753371:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f702 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753380:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:0.0:1788658494.753383:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788658494.753387:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f702 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753394:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f702 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753410:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753416:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6f4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753431:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753435:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658494.753438:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753443:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753461:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658494.753463:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658494.753466:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6f4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753472:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f6f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658494.753481:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003146947f reply state 00000000270f4644 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753491:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.753496:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e90e70300) 00010000:00010000:0.0:1788658494.753498:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658494.753501:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658494.753583:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:12409:x1875544001051136:12345-192.168.202.53@tcp:36:rm.0 Request processed in 1756us (2062us total) trans 4294967483 rc 0/0 00010000:00010000:3.0:1788658494.753586:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658494.753592:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658494.753597:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 214 00010000:00010000:3.0:1788658494.753606:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.753617:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:3.0:1788658494.753621:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788658494.753633:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.753640:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f709 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.753653:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658494.753655:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658494.753657:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658494.811990:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658494.812311:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001051392 00000100:00100000:0.0:1788658494.812324:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001051392 00000100:00100000:0.0:1788658494.812418:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 215 00000100:00100000:0.0:1788658494.812431:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+39:12415:x1875544001051392:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658494.812466:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658494.812502:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f710 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca27 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.812677:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f717 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.812759:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f717 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.812783:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f717 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.812802:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.812810:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.812817:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658494.817509:0:6537:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788658494.817901:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818141:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818161:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818214:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f717 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818222:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f717 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818229:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f717 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818322:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658494.818328:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f717 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818336:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f717 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818418:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658494.818422:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658494.818429:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f717 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818437:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f717 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658494.818455:0:6537:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cbd9b0a reply state 000000004f405c96 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818468:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818474:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e90e70300) 00010000:00010000:0.0:1788658494.818477:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658494.818480:0:6537:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788658494.818528:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f710 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca27 expref: 42 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818548:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca27 expref: 41 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658494.818567:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:0.0:1788658494.818570:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658494.818573:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670600, rc 0) 00000100:00100000:0.0:1788658494.818889:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+42:12415:x1875544001051392:12345-192.168.202.53@tcp:101:bash.0 Request processed in 6459us (6913us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788658494.818899:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 215 00000100:00100000:1.0:1788658494.823866:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.824033:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001051520 00000100:00100000:3.0:1788658494.824047:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001051520 00000100:00100000:3.0:1788658494.824174:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:3.0:1788658494.824188:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2396:x1875544001051520:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1788658494.824216:0:8454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658494.824457:0:8454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786b87a8/0x48e67cc629c6f733 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca2e expref: -99 pid: 8454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658494.824495:0:8454:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658494.824524:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=412s v=(0 0) 00010000:00010000:3.0:1788658494.824530:0:8454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658494.824542:0:8454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786b87a8/0x48e67cc629c6f733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca2e expref: 8 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.824569:0:8454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000786b87a8/0x48e67cc629c6f733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca2e expref: 8 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.824587:0:8454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96400, rc 0) 00000100:00100000:3.0:1788658494.824670:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001051520:12345-192.168.202.53@tcp:101:bash.0 Request processed in 485us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.824698:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:1.0:1788658494.828475:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.828616:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001051648 00000100:00100000:3.0:1788658494.828629:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001051648 00000100:00100000:3.0:1788658494.828745:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:3.0:1788658494.828760:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:12415:x1875544001051648:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1788658494.828787:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658494.828813:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca35 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.828854:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000786b87a8/0x48e67cc629c6f733 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca2e expref: 9 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.828865:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658494.828870:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658494.828877:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.828922:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000786b87a8/0x48e67cc629c6f733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca2e expref: 9 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.828939:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000786b87a8/0x48e67cc629c6f733 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca2e expref: 9 pid: 8454 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658494.828955:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8453:1875544025224960:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658494.829478:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658494.835671:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658494.835901:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8453:1875544025224960:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658494.835951:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 9 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658494.835980:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96600, rc 0) 00000100:00100000:3.0:1788658494.836055:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:12415:x1875544001051648:12345-192.168.202.53@tcp:101:bash.0 Request processed in 7299us (7595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.836078:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:1.0:1788658494.836182:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001051776 00000100:00100000:1.0:1788658494.836192:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001051776 00010000:00010000:1.0:1788658494.836244:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000786b87a8/0x48e67cc629c6f733 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca2e expref: 9 pid: 8454 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658494.836285:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 95 00000100:00100000:1.0:1788658494.836296:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2397:x1875544001051776:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658494.836314:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658494.836344:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000786b87a8/0x48e67cc629c6f733 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca2e expref: 9 pid: 8454 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.836360:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000786b87a8/0x48e67cc629c6f733 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca2e expref: 9 pid: 8454 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.836416:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786b87a8/0x48e67cc629c6f733 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca2e expref: 9 pid: 8454 timeout: 512 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.836433:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658494.836438:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658494.836450:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.836461:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658494.836500:0:6521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658494.836517:0:6521:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8374ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6521:1875544025225088:192.168.202.53@tcp:105: 00000100:00100000:1.0:1788658494.838024:0:6521:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e831580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658494.842110:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658494.842270:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001052032 00000100:00100000:1.0:1788658494.842279:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001052032 00000100:00100000:1.0:1788658494.842341:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:1.0:1788658494.842358:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+42:12415:x1875544001052032:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:1.0:1788658494.842663:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:12415:x1875544001052032:12345-192.168.202.53@tcp:35:bash.0 Request processed in 306us (560us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788658494.842671:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:2.0:1788658494.843256:0:6521:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8374ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6521:1875544025225088:192.168.202.53@tcp:105: 00010000:00010000:2.0:1788658494.843280:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658494.843337:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2397:x1875544001051776:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 7042us (7681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658494.843348:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 95 00000100:00100000:1.0:1788658494.911261:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025225216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658494.911340:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658494.911462:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658494.911537:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025225216 00000100:00100000:3.0:1788658494.911545:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025225216 00000100:00100000:3.0:1788658494.911595:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788658494.911606:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8374ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025225216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658494.911640:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788658494.911793:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025225216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658494.911878:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8374ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025225216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658494.911887:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788658495.026517:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658495.026632:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001052160 00000100:00100000:2.0:1788658495.026642:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001052160 00000100:00100000:2.0:1788658495.026693:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 216 00000100:00100000:2.0:1788658495.026720:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+43:12431:x1875544001052160:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658495.026742:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658495.026759:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f741 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca3c expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.026813:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f748 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.026825:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.026835:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658495.026883:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788658495.026886:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658495.026900:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f748 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.026918:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f741 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca3c expref: 45 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.026930:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f748 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca3c expref: 44 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.026936:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:2.0:1788658495.026948:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658495.026951:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0600, rc 0) 00000100:00100000:2.0:1788658495.027000:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+44:12431:x1875544001052160:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 300us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658495.027005:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 216 00000100:00100000:1.0:1788658495.033497:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658495.033659:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001052416 00000100:00100000:0.0:1788658495.033670:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001052416 00000100:00100000:0.0:1788658495.033753:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 217 00000100:00100000:0.0:1788658495.033765:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+44:12431:x1875544001052416:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658495.033790:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658495.033819:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f74f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca43 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.033950:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f756 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.033965:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.033977:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f756 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658495.033987:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788658495.034110:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f74f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca43 expref: 47 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.034153:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f756 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca43 expref: 46 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.034161:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:0.0:1788658495.034164:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658495.034168:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671a00, rc 0) 00000100:00100000:0.0:1788658495.034236:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+46:12431:x1875544001052416:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 473us (751us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788658495.034244:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 217 00000100:00100000:0.0:1788658495.038464:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658495.038603:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001052672 00000100:00100000:3.0:1788658495.038614:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001052672 00000100:00100000:3.0:1788658495.038692:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 218 00000100:00100000:3.0:1788658495.038735:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+46:12431:x1875544001052672:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658495.038760:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658495.038782:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f764 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca4a expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.038891:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f76b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.038927:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f76b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.039527:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f76b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658495.039545:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788658495.039663:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f764 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca4a expref: 49 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.039683:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f76b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca4a expref: 48 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.039691:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:3.0:1788658495.039694:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788658495.039697:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96800, rc 0) 00000100:00100000:3.0:1788658495.039854:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+48:12431:x1875544001052672:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1152us (1398us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1788658495.039862:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 218 00000100:00100000:3.0:1788658495.042598:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658495.043159:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001052800 00000100:00100000:1.0:1788658495.043171:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001052800 00000100:00100000:1.0:1788658495.043236:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:1.0:1788658495.043246:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+48:2399:x1875544001052800:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658495.043260:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658495.043287:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f756 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca43 expref: 48 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.043309:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:1.0:1788658495.043314:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658495.043389:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae3b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+47:2399:x1875544001052800:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 145us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658495.043405:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:1.0:1788658495.050158:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658495.050307:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001052928 00000100:00100000:3.0:1788658495.050317:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001052928 00000100:00100000:3.0:1788658495.050567:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:3.0:1788658495.050578:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001052928:12345-192.168.202.53@tcp:1:lfs.0 00010000:00010000:3.0:1788658495.050623:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.050660:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.050668:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658495.050672:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658495.050676:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658495.050787:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788658495.050794:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 8 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.050809:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 8 pid: 8453 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658495.050823:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83671880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8452:1875544025225344:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658495.050933:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658495.052890:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83671880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8452:1875544025225344:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658495.052917:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658495.055875:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658495.055993:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001053056 00000100:00100000:2.0:1788658495.056004:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001053056 00002000:00100000:2.0:1788658495.056065:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8a1eadba1880 x1875544001053056/t0(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:86/0 lens 504/0 e 0 to 0 dl 1788658506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788658495.056076:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1eadba1880 with x1875544001053056 ext(0->8) 00010000:00010000:2.0:1788658495.056086:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 9 pid: 8453 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.056102:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 9 pid: 8453 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658495.056128:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a1eadba1880 00000100:00100000:2.0:1788658495.056170:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:2.0:1788658495.056180:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2397:x1875544001053056:12345-192.168.202.53@tcp:4:lfs.0 00000100:00100000:2.0:1788658495.057605:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:2397:x1875544001053056:12345-192.168.202.53@tcp:4:lfs.0 Request processed in 1418us (1734us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788658495.057617:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00002000:00100000:2.0:1788658495.057627:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8a1eadba1880 x1875544001053056/t4294967309(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:86/0 lens 504/448 e 0 to 0 dl 1788658506 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788658495.057637:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1eadba1880 with x1875544001053056 ext(0->8) 00010000:00010000:2.0:1788658495.057645:0:8457:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 11 pid: 8453 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.057661:0:8457:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 11 pid: 8453 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658495.057668:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a1eadba1880 00000100:00100000:0.0:1788658495.059882:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658495.060030:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001053184 00000100:00100000:2.0:1788658495.060050:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001053184 00010000:00010000:2.0:1788658495.060092:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 11 pid: 8453 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658495.060190:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 96 00000100:00100000:2.0:1788658495.060199:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:2396:x1875544001053184:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658495.060237:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788658495.060255:0:6523:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788658495.060258:0:6523:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788658494 00002000:00010000:2.0:1788658495.060260:0:6523:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788658494 00002000:00010000:2.0:1788658495.060261:0:6523:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788658494 00002000:00010000:2.0:1788658495.060263:0:6523:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788658495.060267:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 11 pid: 8453 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.060277:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 11 pid: 8453 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.060299:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f73a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca35 expref: 11 pid: 8453 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.060316:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658495.060333:0:6523:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658495.060340:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.060349:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.060390:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658495.060452:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:2396:x1875544001053184:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 253us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658495.060460:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 96 00010000:00010000:3.0:1788658495.060514:0:8452:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.060524:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.060552:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.060561:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.060568:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.060575:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658495.060579:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.060588:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.060601:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.060609:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a21d7b33/0x48e67cc629c6f779 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658495.060656:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2396:x1875544001052928:12345-192.168.202.53@tcp:1:lfs.0 Request processed in 10080us (10506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658495.060664:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:3.0:1788658495.065617:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658495.065754:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001053440 00000100:00100000:0.0:1788658495.065764:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001053440 00000100:00100000:0.0:1788658495.065833:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1788658495.065846:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+47:12431:x1875544001053440:12345-192.168.202.53@tcp:35:lfs.0 00000004:00010000:0.0:1788658495.065912:0:6539:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f76b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca4a expref: 47 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788658495.066125:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788658495.066161:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788658495.066616:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788658495.066660:0:6539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.066676:0:6539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca27 expref: 51 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.066699:0:6539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.066817:0:6539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca27 expref: 51 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.066834:0:6539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca27 expref: 51 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658495.066851:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6539:1875544025225472:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658495.066983:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658495.070021:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6539:1875544025225472:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658495.070064:0:6539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658495.072298:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658495.072781:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001053568 00000100:00100000:1.0:1788658495.072792:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001053568 00010000:00010000:1.0:1788658495.072835:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca27 expref: 52 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658495.073029:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 97 00000100:00100000:1.0:1788658495.073051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+52:2396:x1875544001053568:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658495.073068:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658495.073090:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca27 expref: 52 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.073103:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca27 expref: 52 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.073128:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca27 expref: 52 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.073145:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:1.0:1788658495.073150:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.073159:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.073167:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.073203:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658495.073262:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+51:2396:x1875544001053568:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 222us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658495.073270:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 97 00010000:00010000:2.0:1788658495.073602:0:6539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.073611:0:6539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658495.073751:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1788658495.073868:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788658495.073965:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875544025225600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788658495.074019:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658495.074081:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658495.074353:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025225600 00000100:00100000:0.0:1788658495.074360:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025225600 00000100:00100000:0.0:1788658495.074425:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788658495.074434:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6539:x1875544025225600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788658495.074516:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6539:x1875544025225600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 83us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658495.074524:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1788658495.074678:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658495.074748:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875544025225600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788658495.074863:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788658495.074907:0:6539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875544025225728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788658495.074949:0:6539:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658495.074969:0:6539:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb5ecf480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658495.075875:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025225728 00000100:00100000:2.0:1788658495.075884:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025225728 00000100:00100000:2.0:1788658495.075932:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788658495.075951:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6539:x1875544025225728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788658495.076108:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6539:x1875544025225728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (1157us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788658495.076116:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788658495.076175:0:6539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6539:1875544025225728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788658495.076227:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788658495.076261:0:6539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.076269:0:6539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.076277:0:6539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.076283:0:6539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658495.076288:0:6539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.076296:0:6539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.076311:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:2.0:1788658495.076314:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788658495.076503:0:6539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.076512:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f780 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788658495.076621:0:6539:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788658495.076678:0:6539:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788658495.076690:0:6539:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 412292986458ns, next at 413292983910ns, rc = 0 00000001:00080000:2.0:1788658495.076696:0:6539:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788658495.076748:0:6539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e70e00) 00010000:00010000:2.0:1788658495.076758:0:6539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788658495.076766:0:6539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f76b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca4a expref: 55 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658495.076862:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+54:12431:x1875544001053440:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 11019us (12542us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788658495.076871:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000020:00080000:2.0:1788658495.076875:0:6539:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788658495.082738:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658495.082906:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001053696 00000100:00100000:3.0:1788658495.082917:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001053696 00000100:00100000:3.0:1788658495.082989:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 219 00000100:00100000:3.0:1788658495.083000:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+54:12431:x1875544001053696:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658495.083024:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658495.083058:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f787 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca51 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.083120:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f787 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca51 expref: 55 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.083136:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f787 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca51 expref: 55 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.083156:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658495.083160:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658495.083164:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96400, rc 0) 00000100:00100000:3.0:1788658495.083233:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+55:12431:x1875544001053696:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 234us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658495.083240:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 219 00000100:00100000:2.0:1788658495.089614:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658495.089838:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001053952 00000100:00100000:1.0:1788658495.089850:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001053952 00000100:00100000:0.0:1788658495.090092:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1788658495.090105:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+55:12431:x1875544001053952:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:0.0:1788658495.090548:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+56:12431:x1875544001053952:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 433us (1002us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788658495.090556:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:2.0:1788658495.192085:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658495.192211:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001054080 00000100:00100000:1.0:1788658495.192220:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001054080 00000100:00100000:1.0:1788658495.192274:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 220 00000100:00100000:1.0:1788658495.192285:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+56:12441:x1875544001054080:12345-192.168.202.53@tcp:34:lfs.0 00010000:00010000:1.0:1788658495.192366:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f78e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192411:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f78e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192425:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f78e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192439:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f795 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192446:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192452:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192526:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192535:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192542:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788658495.192595:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192607:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f78e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192614:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f78e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192632:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f78e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192638:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658495.192642:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f78e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192651:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f78e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192664:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:1.0:1788658495.192667:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658495.192672:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f78e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192679:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f78e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192693:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192700:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f795 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192744:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192747:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658495.192750:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192762:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f795 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192768:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e90e70300) 00010000:00010000:1.0:1788658495.192769:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658495.192779:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f795 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192783:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f795 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192790:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192794:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192797:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192800:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658495.192802:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192805:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192808:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:1.0:1788658495.192810:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658495.192811:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.192821:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f79c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658495.192886:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+56:12441:x1875544001054080:12345-192.168.202.53@tcp:34:lfs.0 Request processed in 603us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658495.192892:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 220 00000100:00100000:2.0:1788658495.252869:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658495.252974:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001054336 00000100:00100000:3.0:1788658495.252986:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001054336 00000100:00100000:3.0:1788658495.253116:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 221 00000100:00100000:3.0:1788658495.253127:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e8f26c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+56:12445:x1875544001054336:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658495.253147:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658495.253181:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f7a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca58 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.253255:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f7aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.253268:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f7aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.253280:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f7aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.253292:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f7b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.253357:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.253372:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.253872:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.253883:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.253891:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658495.253901:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788658495.253981:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f7aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254001:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f7aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254008:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f7aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254014:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658495.254029:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f7aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254038:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f7aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254051:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658495.254054:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658495.254059:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f7aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254066:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f7aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254082:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254089:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f7b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254094:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254099:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658495.254110:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254115:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f7b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254124:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e90e70300) 00010000:00010000:3.0:1788658495.254126:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658495.254129:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f7b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254134:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f7b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254170:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f7a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca58 expref: 59 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254184:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca58 expref: 58 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.254191:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658495.254193:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658495.254195:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96800, rc 0) 00000100:00100000:3.0:1788658495.254273:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e8f26c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+58:12445:x1875544001054336:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1147us (1415us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788658495.254281:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 221 00000100:00100000:3.0:1788658495.261275:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658495.261395:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001054464 00000100:00100000:1.0:1788658495.261404:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001054464 00000100:00100000:1.0:1788658495.261473:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 222 00000100:00100000:1.0:1788658495.261484:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+58:12445:x1875544001054464:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:1.0:1788658495.261567:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f7c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.261584:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.261598:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.261638:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.261644:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f7c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.261651:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.261657:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658495.261661:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.261683:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f7c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.261695:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:1.0:1788658495.261698:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658495.261743:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f7c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.261751:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418000/0x48e67cc629c6f7c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658495.261826:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+58:12445:x1875544001054464:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 344us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658495.261834:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 222 00000100:00100000:0.0:1788658495.265802:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658495.265896:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001054720 00000100:00100000:2.0:1788658495.265907:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001054720 00000100:00100000:2.0:1788658495.265968:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:2.0:1788658495.265978:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+58:12445:x1875544001054720:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1788658495.266221:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+59:12445:x1875544001054720:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 244us (428us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788658495.266229:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:3.0:1788658495.361886:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658495.361954:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001054976 00000100:00100000:2.0:1788658495.361964:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001054976 00000100:00100000:2.0:1788658495.362096:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 223 00000100:00100000:2.0:1788658495.362106:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+59:12455:x1875544001054976:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658495.362129:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658495.362131:0:7958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788658495.362157:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f748 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca3c expref: 59 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.362193:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:2.0:1788658495.362197:0:7958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658495.362213:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7cd lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca5f expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.362325:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.362339:0:7958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca58 expref: 59 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.362345:0:7958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.362375:0:7958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca58 expref: 59 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.362401:0:7958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca58 expref: 59 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658495.362423:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025225856:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658495.362511:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83392780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658495.364793:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025225856:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658495.364821:0:7958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658495.365334:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658495.365734:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001055104 00000100:00100000:1.0:1788658495.365743:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001055104 00010000:00010000:1.0:1788658495.365781:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca58 expref: 60 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658495.365816:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 98 00000100:00100000:1.0:1788658495.365825:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+60:2396:x1875544001055104:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658495.365839:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658495.365845:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca58 expref: 60 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.365858:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca58 expref: 60 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.365910:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f7b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca58 expref: 60 pid: 6537 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.365929:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:1.0:1788658495.365934:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.365944:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.365952:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.365975:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658495.365982:0:7958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.365996:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658495.366024:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00000100:00100000:1.0:1788658495.366030:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+59:2396:x1875544001055104:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 207us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658495.366038:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 98 00010000:00010000:2.0:1788658495.366154:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca5f expref: 60 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.366175:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca5f expref: 59 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.366183:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658495.366185:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788658495.366188:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1400, rc 0) 00000100:00100000:2.0:1788658495.366212:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+59:12455:x1875544001054976:12345-192.168.202.53@tcp:101:bash.0 Request processed in 4107us (4337us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788658495.366218:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 223 00000100:00100000:3.0:1788658495.373514:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658495.373748:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001055232 00000100:00100000:0.0:1788658495.373763:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001055232 00000100:00100000:0.0:1788658495.373809:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 224 00000100:00100000:0.0:1788658495.373817:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+59:12455:x1875544001055232:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658495.373836:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658495.373853:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f7e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca66 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.373880:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.373891:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.373913:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.374135:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f7e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca66 expref: 61 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.374151:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca66 expref: 60 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.374165:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:0.0:1788658495.374168:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658495.374170:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670c00, rc 0) 00000100:00100000:0.0:1788658495.374213:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+60:12455:x1875544001055232:12345-192.168.202.53@tcp:101:bash.0 Request processed in 397us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658495.374219:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 224 00000100:00100000:0.0:1788658495.386269:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658495.386676:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001055488 00000100:00100000:2.0:1788658495.386686:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001055488 00000100:00100000:2.0:1788658495.386780:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 225 00000100:00100000:2.0:1788658495.386791:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+60:12455:x1875544001055488:12345-192.168.202.53@tcp:36:bash.0 00010000:00010000:2.0:1788658495.387031:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.387048:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.387062:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658495.387133:0:11974:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1788658495.387159:0:11974:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b601892a reply state 00000000f633854b transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.387171:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.387179:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658495.388090:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788658495.388095:0:11974:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658495.388209:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+63:12455:x1875544001055488:12345-192.168.202.53@tcp:36:bash.0 Request processed in 1417us (1950us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788658495.388218:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 225 00000020:00080000:2.0:1788658495.388223:0:11974:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788658495.391764:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658495.391886:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001055616 00000100:00100000:2.0:1788658495.391896:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001055616 00000100:00100000:2.0:1788658495.391967:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 226 00000100:00100000:2.0:1788658495.391978:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+63:12455:x1875544001055616:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658495.392009:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658495.392030:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f7f7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca6d expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.392128:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.392143:0:7958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca5f expref: 64 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.392170:0:7958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.392206:0:7958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca5f expref: 64 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.392219:0:7958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca5f expref: 64 pid: 7958 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658495.392233:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025225984:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658495.392330:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83392780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658495.400419:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658495.400591:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001055744 00000100:00100000:0.0:1788658495.400599:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001055744 00010000:00010000:0.0:1788658495.400652:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca5f expref: 65 pid: 7958 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658495.400692:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025225984:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658495.400717:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 99 00000100:00100000:0.0:1788658495.400727:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+65:2397:x1875544001055744:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658495.400741:0:7958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.400742:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658495.400748:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca5f expref: 65 pid: 7958 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.400760:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca5f expref: 65 pid: 7958 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.400783:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f7d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca5f expref: 65 pid: 7958 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.400798:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:0.0:1788658495.400803:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.400813:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.400822:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658495.400852:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658495.400899:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+64:2397:x1875544001055744:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 172us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658495.400920:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 99 00010000:00010000:2.0:1788658495.401067:0:7958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.401075:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658495.401133:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788658495.401137:0:7958:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658495.401159:0:7958:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.401188:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f7f7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca6d expref: 64 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.401217:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca6d expref: 63 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.401225:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658495.401228:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658495.401230:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0e00, rc 0) 00000100:00100000:2.0:1788658495.401269:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+63:12455:x1875544001055616:12345-192.168.202.53@tcp:101:bash.0 Request processed in 9293us (9515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658495.401276:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 226 00000100:00100000:3.0:1788658495.406100:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658495.406226:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001056000 00000100:00100000:0.0:1788658495.406236:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001056000 00000100:00100000:2.0:1788658495.406339:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:2.0:1788658495.406361:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+63:12455:x1875544001056000:12345-192.168.202.53@tcp:35:bash.0 00000100:00100000:2.0:1788658495.406603:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+64:12455:x1875544001056000:12345-192.168.202.53@tcp:35:bash.0 Request processed in 243us (513us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788658495.406611:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:0.0:1788658495.504803:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658495.504914:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001056128 00000100:00100000:3.0:1788658495.504925:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001056128 00000100:00100000:3.0:1788658495.504984:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 227 00000100:00100000:3.0:1788658495.505002:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+64:12461:x1875544001056128:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658495.505030:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658495.505053:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f805 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca74 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.505131:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f80c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.505145:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f80c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.505158:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f80c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658495.505207:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788658495.505211:0:6537:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788658495.505231:0:6537:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f80c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.505254:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f805 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca74 expref: 66 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.505578:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f80c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca74 expref: 65 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.505672:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658495.505675:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658495.505679:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97c00, rc 0) 00000100:00100000:3.0:1788658495.505851:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+65:12461:x1875544001056128:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 850us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658495.505859:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 227 00000100:00100000:3.0:1788658495.509265:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658495.509649:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001056256 00000100:00100000:2.0:1788658495.509659:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001056256 00000100:00100000:2.0:1788658495.509874:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 228 00000100:00100000:2.0:1788658495.509884:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+65:12461:x1875544001056256:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658495.509906:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658495.509931:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f813 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca7b expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.511863:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f81a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.511899:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f81a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.511911:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f81a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.511924:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f821 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.511932:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.511939:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512035:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512042:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512047:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658495.512086:0:11974:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788658495.512089:0:11974:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658495.512105:0:11974:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512114:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512129:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f81a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512133:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f81a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512139:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f81a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512142:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658495.512145:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f81a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512150:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f81a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512159:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:2.0:1788658495.512160:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658495.512163:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f81a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512167:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f81a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512175:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f821 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512178:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f821 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512182:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512189:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658495.512191:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f821 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512195:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f821 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512199:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e90e70300) 00010000:00010000:2.0:1788658495.512200:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658495.512202:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f821 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512205:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f821 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512229:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1600/0x48e67cc629c6f813 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca7b expref: 67 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512238:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca7b expref: 66 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.512242:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658495.512244:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658495.512246:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1e00, rc 0) 00000100:00100000:2.0:1788658495.512300:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:12461:x1875544001056256:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 2419us (3046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658495.512306:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 228 00000100:00100000:2.0:1788658495.515933:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658495.516418:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001056512 00000100:00100000:3.0:1788658495.516429:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001056512 00000100:00100000:3.0:1788658495.516506:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 229 00000100:00100000:3.0:1788658495.516517:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:12461:x1875544001056512:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658495.516536:0:7958:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658495.516555:0:7958:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f82f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca82 expref: -99 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.516669:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.516681:0:7958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca6d expref: 67 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.516687:0:7958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca7b expref: 67 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.516692:0:7958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.516747:0:7958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca7b expref: 67 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.516756:0:7958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca7b expref: 67 pid: 11974 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658495.516766:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025226112:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658495.517173:0:7958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca6d expref: 67 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.517183:0:7958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca6d expref: 67 pid: 7958 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658495.517192:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025226240:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658495.517266:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658495.517574:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001056640 00000100:00100000:1.0:1788658495.517580:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001056640 00010000:00010000:1.0:1788658495.517615:0:6523:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca7b expref: 68 pid: 11974 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658495.517648:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 100 00000100:00100000:1.0:1788658495.517657:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+68:2396:x1875544001056640:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658495.517666:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658495.517672:0:6523:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca7b expref: 68 pid: 11974 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.517697:0:6523:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca7b expref: 68 pid: 11974 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.517739:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:1.0:1788658495.517744:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.517751:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.517757:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658495.517797:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+68:2396:x1875544001056640:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 141us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658495.517804:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 100 00000100:00100000:3.0:1788658495.521384:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812bb40 going to sleep for 11 seconds 00010000:00010000:3.0:1788658495.522303:0:7958:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.53@tcp) returned -22 from blocking AST (req@00000000ac7c73be x1875544025226112) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca7b expref: 67 pid: 11974 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.522325:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1e00/0x48e67cc629c6f828 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca7b expref: 67 pid: 11974 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658495.522343:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83672680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025226112:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658495.528773:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658495.528860:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025226240:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658495.528884:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658495.528904:0:7958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.528915:0:7958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.528924:0:7958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658495.529010:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001056768 00000100:00100000:1.0:1788658495.529017:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001056768 00010000:00010000:1.0:1788658495.529047:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca6d expref: 67 pid: 7958 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658495.529078:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 101 00000100:00100000:1.0:1788658495.529085:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:2396:x1875544001056768:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658495.529096:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658495.529101:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca6d expref: 67 pid: 7958 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.529109:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca6d expref: 67 pid: 7958 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.529133:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0e00/0x48e67cc629c6f7fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca6d expref: 67 pid: 7958 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.529144:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:1.0:1788658495.529146:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.529152:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.529157:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.529179:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658495.529218:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:2396:x1875544001056768:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 133us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658495.529223:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 101 00010000:00010000:2.0:1788658495.529358:0:7958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.529366:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658495.529385:0:7958:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788658495.529530:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6f82f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca82 expref: 67 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.529544:0:7958:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca82 expref: 66 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.529549:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658495.529551:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788658495.529552:0:7958:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96c00, rc 0) 00000100:00100000:2.0:1788658495.529573:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:12461:x1875544001056512:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 13060us (13653us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788658495.529577:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 229 00000100:00100000:2.0:1788658495.535334:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658495.535532:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001057024 00000100:00100000:1.0:1788658495.535543:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001057024 00000100:00100000:1.0:1788658495.535618:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:1.0:1788658495.535628:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:12461:x1875544001057024:12345-192.168.202.53@tcp:103:lfs.0 00010000:00010000:1.0:1788658495.535645:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658495.535670:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96400/0x48e67cc629c6f787 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca51 expref: 66 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658495.535689:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:1.0:1788658495.535695:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658495.535787:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae3b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+65:12461:x1875544001057024:12345-192.168.202.53@tcp:103:lfs.0 Request processed in 160us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658495.535794:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:0.0:1788658495.538292:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658495.538373:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001057152 00000100:00100000:3.0:1788658495.538392:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001057152 00000100:00100000:3.0:1788658495.538443:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 230 00000100:00100000:3.0:1788658495.538453:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+65:12461:x1875544001057152:12345-192.168.202.53@tcp:58:lfs.0 00010000:00010000:3.0:1788658495.538577:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.538605:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658495.538619:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658495.538731:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788658495.538805:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+65:12461:x1875544001057152:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 352us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658495.538812:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 230 00000100:00100000:0.0:1788658495.542257:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658495.542330:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001057280 00000100:00100000:2.0:1788658495.542339:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001057280 00000100:00100000:2.0:1788658495.542399:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 231 00000100:00100000:2.0:1788658495.542410:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+65:12461:x1875544001057280:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658495.542428:0:11974:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658495.542447:0:11974:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f84b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca89 expref: -99 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.542527:0:11974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.542538:0:11974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f84b lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca89 expref: 66 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.542556:0:11974:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.542568:0:11974:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f84b lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca89 expref: 66 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.542581:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658495.542584:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658495.542588:0:11974:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f84b lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca89 expref: 66 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658495.542760:0:11974:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1000, rc 0) 00000100:00100000:2.0:1788658495.542807:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:12461:x1875544001057280:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 400us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658495.542812:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 231 00010000:00010000:0.0:1788658495.937460:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658496.063399:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658496.063410:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658496.063438:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788658496.063448:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788658496.064586:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025226368:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788658496.064810:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788658496.088532:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025226368:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788658496.093485:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658496.093749:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001057408 00000100:00100000:2.0:1788658496.093758:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001057408 00000100:00100000:2.0:1788658496.093839:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 232 00000100:00100000:2.0:1788658496.093850:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:12462:x1875544001057408:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788658496.093884:0:7958:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788658496.094025:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:12462:x1875544001057408:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 177us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658496.094033:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 232 00000100:00080000:0.0:1788658496.095592:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658496.100648:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658496.100856:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001057536 00000100:00100000:1.0:1788658496.100867:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001057536 00000100:00100000:1.0:1788658496.100944:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 233 00000100:00100000:1.0:1788658496.100954:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:12462:x1875544001057536:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788658496.101032:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f852 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101049:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f852 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101062:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f852 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101079:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f859 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101087:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f859 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101094:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f859 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101116:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101125:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101133:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658496.101196:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788658496.101200:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658496.101519:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101533:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f852 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101539:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f852 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101545:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f852 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101551:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658496.101556:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f852 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101564:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f852 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101576:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:1.0:1788658496.101580:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658496.101585:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f852 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101591:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f852 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101603:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f859 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101622:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f859 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101628:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f859 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101633:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658496.101636:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f859 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101642:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f859 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101650:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8a1e83b21600) 00010000:00010000:1.0:1788658496.101653:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658496.101656:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f859 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101660:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f859 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101676:0:6538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101681:0:6538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101686:0:6538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101690:0:6538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658496.101698:0:6538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101968:0:6538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101977:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:1.0:1788658496.101979:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658496.101982:0:6538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.101987:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f860 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658496.102071:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:12462:x1875544001057536:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 1115us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658496.102081:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 233 00000100:00100000:2.0:1788658496.110680:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.111085:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001057792 00000100:00100000:0.0:1788658496.111096:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001057792 00000100:00100000:0.0:1788658496.111457:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 234 00000100:00100000:0.0:1788658496.111469:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+66:12462:x1875544001057792:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658496.111490:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658496.111510:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f867 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca90 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111615:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f86e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111630:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f86e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111660:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f86e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658496.111671:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788658496.111790:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f86e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111797:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f86e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111804:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f86e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111809:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658496.111813:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f86e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111831:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f86e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111843:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:0.0:1788658496.111847:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788658496.111851:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f86e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111857:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f86e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111897:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f867 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca90 expref: 68 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111932:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:0.0:1788658496.111934:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658496.111939:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f867 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca90 expref: 68 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.111950:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670a00, rc 0) 00000100:00100000:0.0:1788658496.112018:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:12462:x1875544001057792:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 552us (1348us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1788658496.112026:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 234 00000100:00100000:3.0:1788658496.116350:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658496.117616:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001057920 00000100:00100000:2.0:1788658496.117629:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001057920 00000100:00100000:2.0:1788658496.117697:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 235 00000100:00100000:2.0:1788658496.117732:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:12462:x1875544001057920:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788658496.117769:0:7958:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788658496.118078:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:12462:x1875544001057920:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 348us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658496.118086:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 235 00000100:00100000:3.0:1788658496.131251:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658496.131478:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001058176 00000100:00100000:1.0:1788658496.131489:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001058176 00000100:00100000:1.0:1788658496.131804:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 236 00000100:00100000:1.0:1788658496.131831:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:12462:x1875544001058176:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658496.131854:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658496.131857:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788658496.131883:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c6f80c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca74 expref: 67 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.131903:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:1.0:1788658496.131910:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658496.132023:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f87c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca97 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788658496.133252:0:6538:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788658496.133896:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f883 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.133908:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.133928:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f883 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.133993:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f87c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca97 expref: 69 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.134011:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f883 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca97 expref: 68 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.134019:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:1.0:1788658496.134021:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788658496.134138:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419600, rc 0) 00000100:00100000:1.0:1788658496.134218:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+68:12462:x1875544001058176:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 2401us (2977us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788658496.134227:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 236 00000100:00100000:3.0:1788658496.140985:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658496.141143:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001058432 00000100:00100000:2.0:1788658496.141154:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001058432 00000100:00100000:2.0:1788658496.141615:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 237 00000100:00100000:2.0:1788658496.141627:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+68:12462:x1875544001058432:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658496.141687:0:7958:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658496.141731:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419600/0x48e67cc629c6f883 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca97 expref: 68 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141749:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:2.0:1788658496.141762:0:7958:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658496.141783:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f891 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141796:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f891 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141813:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f891 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141830:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f898 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x68711bd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141837:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x68711bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141844:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x68711bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141887:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f891 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141894:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f891 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141899:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f891 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141904:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658496.141908:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f891 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141925:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f891 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141933:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:2.0:1788658496.141936:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658496.141939:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f891 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141952:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f891 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141962:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x68711bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141968:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f898 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x68711bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141974:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f898 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x68711bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141978:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658496.141981:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f898 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x68711bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141987:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f898 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x68711bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.141995:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x68711bd6 (ffff8a1d83406900) 00010000:00010000:2.0:1788658496.141997:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658496.142000:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f898 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x68711bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.142006:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f898 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x68711bd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.142084:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:12462:x1875544001058432:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 459us (1107us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658496.142091:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 237 00000100:00100000:2.0:1788658496.152425:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658496.152577:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001058560 00000100:00100000:1.0:1788658496.152587:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001058560 00000100:00100000:1.0:1788658496.152648:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 238 00000100:00100000:1.0:1788658496.152659:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+67:12462:x1875544001058560:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658496.152678:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658496.152752:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f89f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bcca9e expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.152790:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.152801:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.152818:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.152910:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419800/0x48e67cc629c6f89f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca9e expref: 69 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.152938:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca9e expref: 68 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.152946:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:1.0:1788658496.152949:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788658496.152954:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419a00, rc 0) 00000100:00100000:1.0:1788658496.153014:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+68:12462:x1875544001058560:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 358us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658496.153019:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 238 00000100:00100000:3.0:1788658496.156935:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658496.157554:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001058816 00000100:00100000:1.0:1788658496.157566:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001058816 00000100:00100000:1.0:1788658496.157630:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 239 00000100:00100000:1.0:1788658496.157640:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+68:12462:x1875544001058816:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788658496.157860:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.157890:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.157902:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788658496.158072:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788658496.158083:0:6538:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 413374379056ns, next at 414374376521ns, rc = 0 00000004:00010000:1.0:1788658496.158133:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093fcdb52 reply state 000000001309b5c6 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.158145:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.158153:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:1.0:1788658496.158156:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788658496.158159:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788658496.158753:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+70:12462:x1875544001058816:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 1112us (1838us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788658496.158759:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 239 00000100:00100000:2.0:1788658496.161995:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.162100:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001058944 00000100:00100000:0.0:1788658496.162110:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001058944 00000100:00100000:0.0:1788658496.162205:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 240 00000100:00100000:0.0:1788658496.162216:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+70:12462:x1875544001058944:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658496.162249:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658496.162279:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f8b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccaa5 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.162345:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f8b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaa5 expref: 71 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.162360:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f8b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaa5 expref: 71 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.162378:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:0.0:1788658496.162382:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658496.162401:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670a00, rc 0) 00000100:00100000:0.0:1788658496.162462:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+71:12462:x1875544001058944:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 248us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.162470:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 240 00000100:00100000:2.0:1788658496.166051:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658496.166139:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001059072 00000100:00100000:3.0:1788658496.166149:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001059072 00000100:00100000:3.0:1788658496.166228:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:3.0:1788658496.166239:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2396:x1875544001059072:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788658496.166668:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:2396:x1875544001059072:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 429us (624us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788658496.166677:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00080000:0.0:1788658496.167677:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658496.170786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658496.170865:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001059328 00000100:00100000:1.0:1788658496.170872:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001059328 00000100:00100000:1.0:1788658496.170931:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:1.0:1788658496.170942:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+71:12462:x1875544001059328:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788658496.171564:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+72:12462:x1875544001059328:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 622us (864us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788658496.171573:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:1.0:1788658496.180171:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658496.180654:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001059584 00000100:00100000:3.0:1788658496.180665:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001059584 00000100:00100000:3.0:1788658496.180766:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 241 00000100:00100000:3.0:1788658496.180777:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+72:12462:x1875544001059584:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788658496.180898:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+72:12462:x1875544001059584:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 122us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658496.180906:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 241 00000100:00100000:2.0:1788658496.184799:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.184959:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001059712 00000100:00100000:0.0:1788658496.184970:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001059712 00000100:00100000:0.0:1788658496.185032:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 242 00000100:00100000:0.0:1788658496.185042:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+72:12462:x1875544001059712:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658496.185061:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658496.185082:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccaac expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.185152:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.185167:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.185178:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658496.185235:0:6538:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658496.185254:0:6538:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.185282:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaac expref: 74 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.185383:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaac expref: 73 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.185407:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:0.0:1788658496.185410:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788658496.185413:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670600, rc 0) 00000100:00100000:0.0:1788658496.185692:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+73:12462:x1875544001059712:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 651us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.185700:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 242 00000100:00100000:1.0:1788658496.200038:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658496.200142:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001059840 00000100:00100000:3.0:1788658496.200162:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001059840 00000100:00100000:3.0:1788658496.200516:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:3.0:1788658496.200529:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+10:2397:x1875544001059840:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658496.200560:0:8453:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658496.200585:0:8453:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f8c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccab3 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788658496.200612:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc33f, blocks: 0x0 00010000:00010000:3.0:1788658496.200635:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=413s v=(0 0) 00010000:00010000:3.0:1788658496.200653:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658496.200663:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f8c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccab3 expref: 11 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.200683:0:8453:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f8c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccab3 expref: 11 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.200697:0:8453:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96400, rc 0) 00000100:00100000:3.0:1788658496.200781:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:2397:x1875544001059840:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 255us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658496.200788:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:2.0:1788658496.207025:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.207134:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001060096 00000100:00100000:0.0:1788658496.207993:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001060096 00000100:00100000:0.0:1788658496.208110:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 243 00000100:00100000:0.0:1788658496.208122:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+73:12462:x1875544001060096:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788658496.208267:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+73:12462:x1875544001060096:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 147us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.208275:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 243 00000100:00100000:2.0:1788658496.216459:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658496.216645:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001060224 00000100:00100000:3.0:1788658496.216656:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001060224 00000100:00100000:2.0:1788658496.216964:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:2.0:1788658496.216978:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:12462:x1875544001060224:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658496.216999:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658496.217021:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccaba expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.217055:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f8c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccab3 expref: 12 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.217065:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658496.217070:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658496.217076:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 12 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.217111:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f8c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccab3 expref: 12 pid: 8453 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.217124:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f8c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccab3 expref: 12 pid: 8453 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.217176:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8452:1875544025226496:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658496.217413:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d833923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658496.224083:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.224173:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001060352 00000100:00100000:0.0:1788658496.224183:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001060352 00010000:00010000:0.0:1788658496.224244:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f8c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccab3 expref: 13 pid: 8453 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658496.224307:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 102 00000100:00100000:0.0:1788658496.224319:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:2396:x1875544001060352:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658496.224335:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658496.224359:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f8c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccab3 expref: 13 pid: 8453 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.224404:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f8c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccab3 expref: 13 pid: 8453 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.224431:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658496.224435:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658496.224444:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 13 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.224454:0:9539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 13 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.224492:0:9539:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 13 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658496.224506:0:9539:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9539:1875544025226624:192.168.202.53@tcp:105: 00000100:00100000:0.0:1788658496.224886:0:9539:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658496.229629:0:9539:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9539:1875544025226624:192.168.202.53@tcp:105: 00010000:00010000:0.0:1788658496.229660:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658496.229750:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:2396:x1875544001060352:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 5432us (5677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.229760:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 102 00010000:00010000:2.0:1788658496.233512:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000786b87a8/0x48e67cc629c6f8c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccab3 expref: 12 pid: 8453 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.233961:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8452:1875544025226496:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658496.234002:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 11 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.234032:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0400, rc 0) 00000100:00100000:2.0:1788658496.234111:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:12462:x1875544001060224:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 17136us (17661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658496.234120:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 72 00000100:00100000:3.0:1788658496.245894:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658496.246075:0:8458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001060480 00000100:00100000:2.0:1788658496.246085:0:8458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001060480 00002000:00100000:2.0:1788658496.246148:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8a1d83672d80 x1875544001060480/t0(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:87/0 lens 504/0 e 0 to 0 dl 1788658507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788658496.246160:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d83672d80 with x1875544001060480 ext(0->12) 00002000:00010000:2.0:1788658496.246167:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1d83672d80 00000100:00100000:2.0:1788658496.246204:0:8458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:2.0:1788658496.246225:0:8458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+11:2397:x1875544001060480:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788658496.247887:0:8458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:2397:x1875544001060480:12345-192.168.202.53@tcp:4:lhsmtool_posix.0 Request processed in 1664us (1993us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788658496.247923:0:8458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00002000:00100000:2.0:1788658496.247935:0:8458:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8a1d83672d80 x1875544001060480/t4294967321(0) o4->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:87/0 lens 504/448 e 0 to 0 dl 1788658507 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788658496.247946:0:8458:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1d83672d80 with x1875544001060480 ext(0->12) 00002000:00010000:2.0:1788658496.247952:0:8458:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1d83672d80 00000100:00100000:1.0:1788658496.253125:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658496.253519:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001060608 00000100:00100000:2.0:1788658496.253897:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001060608 00000100:00100000:2.0:1788658496.253976:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 244 00000100:00100000:2.0:1788658496.253987:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+73:12462:x1875544001060608:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788658496.258579:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788658496.258598:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:3.0:1788658496.258631:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788658496.258643:0:6515:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:3.0:1788658496.258645:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.258654:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.258660:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97400 already unused, calling callback (ffffffffc177b4f0) 00000020:00080000:1.0:1788658496.258663:0:6515:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1eb5ecf000 refcount 2 committed 0 result 0 batchid 7 00010000:00010000:3.0:1788658496.258665:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788658496.258667:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d83422f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1eb5ecf3c0 00000020:00080000:1.0:1788658496.258670:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d83422d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1eb331de00 00010000:00010000:3.0:1788658496.258673:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.258723:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8a1e90e7e700) 00010000:00010000:3.0:1788658496.258726:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658496.258731:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.258738:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f5d5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788658496.258743:0:6515:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1eb2168d80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788658496.258746:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d835cb800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1e87dada80 00000020:00080000:1.0:1788658496.258749:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1d835cb100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1d824de200 00010000:00010000:3.0:1788658496.258770:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788658496.258775:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00010000:00010000:3.0:1788658496.258776:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.258781:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.258786:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658496.258789:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.258794:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788658496.258834:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788658496.259021:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658496.259040:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025226752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788658496.259103:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658496.259179:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025226880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788658496.259223:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658496.259267:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025226752 00000100:00100000:2.0:1788658496.259274:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025226752 00010000:00010000:3.0:1788658496.259376:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8a1d83406b00) 00010000:00010000:3.0:1788658496.259379:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658496.259383:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259390:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f67d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259426:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259432:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259438:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259443:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658496.259446:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259451:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259460:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e90e70300) 00010000:00010000:3.0:1788658496.259462:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658496.259465:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259471:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671400/0x48e67cc629c6f6fb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259484:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259490:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259495:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259505:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658496.259508:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259515:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259523:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1e90e70300) 00010000:00010000:3.0:1788658496.259525:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658496.259527:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259533:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671000/0x48e67cc629c6f71e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259552:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259558:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259563:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259567:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658496.259570:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259575:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259592:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658496.259594:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658496.259597:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259602:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f7f0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259614:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259620:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259625:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259630:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658496.259632:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259637:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259644:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:3.0:1788658496.259646:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788658496.259649:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.259654:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418800/0x48e67cc629c6f8ad lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658496.260016:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025226880 00000100:00100000:1.0:1788658496.260021:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025226880 00000100:00100000:3.0:1788658496.260440:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025227008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788658496.260487:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658496.260530:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025227008 00000100:00100000:3.0:1788658496.260534:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025227008 00000100:00100000:3.0:1788658496.260591:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788658496.260600:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3650:x1875544025227008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788658496.260625:0:8453:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1788658496.260655:0:8453:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9cc33e, atime: 0x6a9cc33e, ctime: 0x6a9cc33e, blocks: 0x8 00010000:00010000:3.0:1788658496.260663:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.260676:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=413s v=(0 0) 00010000:00010000:3.0:1788658496.260680:0:8453:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658496.260686:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.260716:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.260725:0:8453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.260732:0:8453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.260748:0:8453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788658496.260920:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3650:x1875544025227008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 320us (431us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788658496.260927:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:3.0:1788658496.260949:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658496.260956:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.260964:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658496.260968:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.260977:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.260990:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.260997:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.261012:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658496.261014:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658496.261015:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788658496.261258:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1d8379aa00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788658496.261265:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025227008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788658496.261364:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788658496.261988:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:12462:x1875544001060608:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 8001us (8875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658496.262009:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 244 00000100:00080000:3.0:1788658496.264956:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658496.265119:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788658496.265133:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3649:x1875544025226880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788658496.265175:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3647:x1875544025226752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788658496.265199:0:13833:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1788658496.265234:0:13833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.265265:0:13833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1a21b3b/0x48e67cc629c6f68b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca12 expref: 12 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.265301:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788658496.265306:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658496.265312:0:13833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.265351:0:13833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1a21b3b/0x48e67cc629c6f68b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca12 expref: 12 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.265366:0:13833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1a21b3b/0x48e67cc629c6f68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca12 expref: 12 pid: 8452 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.265381:0:13833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13833:1875544025227136:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658496.265464:0:13833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d833923c0 going to sleep for 11 seconds 00002000:00010000:1.0:1788658496.265506:0:10365:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788658496.265510:0:10365:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788658495 00002000:00010000:1.0:1788658496.265513:0:10365:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788658496.265515:0:10365:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788658495 -> 1788658495 00002000:00010000:1.0:1788658496.265517:0:10365:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788658496.265574:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1875544025226880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 445us (6350us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788658496.267932:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658496.267966:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001060736 00000100:00100000:2.0:1788658496.267975:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001060736 00000001:00080000:3.0:1788658496.268633:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788658496.268648:0:8447:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000004:00080000:0.0:1788658496.269027:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1eb7400e00/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788658496.269036:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025226880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788658496.269832:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.269931:0:13833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13833:1875544025227136:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658496.269969:0:13833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658496.271525:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001060864 00000100:00100000:0.0:1788658496.271608:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001060864 00010000:00010000:0.0:1788658496.271655:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1a21b3b/0x48e67cc629c6f68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca12 expref: 14 pid: 8452 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658496.271725:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 103 00000100:00100000:0.0:1788658496.271737:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+14:2397:x1875544001060864:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658496.271753:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658496.271759:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1a21b3b/0x48e67cc629c6f68b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca12 expref: 14 pid: 8452 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.271774:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1a21b3b/0x48e67cc629c6f68b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca12 expref: 14 pid: 8452 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.271797:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1a21b3b/0x48e67cc629c6f68b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca12 expref: 14 pid: 8452 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.271816:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658496.271820:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658496.271826:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.271836:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.271878:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658496.271947:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+13:2397:x1875544001060864:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 212us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.271955:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 103 00010000:00010000:0.0:1788658496.272084:0:13833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.272094:0:13833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.272103:0:13833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.272113:0:13833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.272131:0:13833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788658496.273547:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3647:x1875544025226752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12163us (14430us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788658496.273562:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:3.0:1788658496.273742:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1eb7401c00/2, rc 0, transno 4294967323 00000100:00100000:3.0:1788658496.273750:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025226752:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788658496.274777:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658496.274789:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.274802:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658496.274806:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.274816:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.274836:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.274843:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002735b5a/0x48e67cc629c6f8de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.274867:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658496.274869:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658496.274887:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658496.278798:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788658496.278866:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:1.0:1788658496.278883:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+12:2396:x1875544001060736:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788658496.288033:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788658496.288056:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1788658496.288374:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2396:x1875544001060736:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 9491us (20443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658496.288387:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 76 00000100:00100000:1.0:1788658496.298526:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.299318:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001061120 00000100:00100000:0.0:1788658496.299330:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001061120 00000100:00100000:0.0:1788658496.299405:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 245 00000100:00100000:0.0:1788658496.299427:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:12462:x1875544001061120:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788658496.299487:0:6538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658496.299529:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaac expref: 21 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.299551:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:0.0:1788658496.299556:0:6538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658496.299587:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.299601:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.299611:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658496.299782:0:6538:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001951b1d4 reply state 000000006c4e0321 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.299795:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.299802:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:0.0:1788658496.299804:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788658496.299807:0:6538:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788658496.299927:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:12462:x1875544001061120:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 511us (1409us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1788658496.299934:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 245 00000100:00100000:2.0:1788658496.303246:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.303348:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001061248 00000100:00100000:0.0:1788658496.303362:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001061248 00000100:00100000:0.0:1788658496.303440:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:0.0:1788658496.303452:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2396:x1875544001061248:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788658496.303669:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788658496.303674:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788658495 -> 1788658494 00002000:00010000:0.0:1788658496.303677:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788658494 00002000:00010000:0.0:1788658496.303679:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788658495 -> 1788658494 00002000:00010000:0.0:1788658496.303682:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788658496.303792:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001061248:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 342us (614us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788658496.303801:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 77 00000100:00100000:2.0:1788658496.309857:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.310028:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001061504 00000100:00100000:0.0:1788658496.310043:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001061504 00000100:00100000:0.0:1788658496.310123:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 246 00000100:00100000:0.0:1788658496.310136:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:12462:x1875544001061504:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788658496.310244:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.310267:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca9e expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.310279:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.310326:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca9e expref: 22 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.310343:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca9e expref: 22 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658496.310388:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875544025227264:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658496.310854:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d8351de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658496.315430:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658496.315585:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875544025227264:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658496.315622:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658496.315938:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001061632 00000100:00100000:3.0:1788658496.315950:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001061632 00010000:00010000:3.0:1788658496.316002:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca9e expref: 23 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658496.316049:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 104 00000100:00100000:3.0:1788658496.316060:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+23:2397:x1875544001061632:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658496.316078:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658496.316086:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca9e expref: 23 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.316100:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca9e expref: 23 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.316128:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419a00/0x48e67cc629c6f8a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca9e expref: 23 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.316148:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:3.0:1788658496.316154:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.316165:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.316174:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.316206:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658496.316308:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:2397:x1875544001061632:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 249us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658496.316317:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 104 00010000:00010000:2.0:1788658496.317747:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.317782:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.317850:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.317859:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.317867:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.317873:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658496.317878:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.317887:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.317915:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:2.0:1788658496.317918:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788658496.317923:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.317930:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c6f8ec lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.318048:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:12462:x1875544001061504:12345-192.168.202.53@tcp:55:lhsmtool_posix.0 Request processed in 7909us (8199us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788658496.318059:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 246 00000100:00100000:0.0:1788658496.327246:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658496.327355:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001061760 00000100:00100000:3.0:1788658496.327370:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001061760 00000100:00100000:3.0:1788658496.327453:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:3.0:1788658496.327466:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001061760:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788658496.327530:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.327569:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.327581:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658496.327585:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658496.327591:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.327639:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.327656:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 8 pid: 8452 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658496.327674:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8452:1875544025227392:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658496.327825:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658496.331579:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.331746:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001061888 00000100:00100000:0.0:1788658496.331760:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001061888 00010000:00010000:0.0:1788658496.331826:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 9 pid: 8452 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658496.331881:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 105 00000100:00100000:0.0:1788658496.331904:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2396:x1875544001061888:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658496.331926:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658496.331954:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 9 pid: 8452 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.331971:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 9 pid: 8452 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.332009:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658496.332014:0:6521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788658496.332023:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.332036:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.332087:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658496.332162:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+9:2396:x1875544001061888:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 270us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.332170:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 105 00010000:00010000:2.0:1788658496.332521:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f03bec0f/0x48e67cc629c6f8d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaba expref: 8 pid: 8452 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.332552:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8452:1875544025227392:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658496.332580:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.332591:0:8452:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.332599:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.332629:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.332637:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.332645:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.332654:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658496.332660:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.332685:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.332699:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.332769:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6f8f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.332839:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2396:x1875544001061760:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 5376us (5610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658496.332848:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 78 00000100:00100000:3.0:1788658496.337537:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658496.337678:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001062144 00000100:00100000:2.0:1788658496.337691:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001062144 00000100:00100000:2.0:1788658496.337816:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 247 00000100:00100000:2.0:1788658496.337829:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:12462:x1875544001062144:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788658496.337958:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.337981:0:7958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca66 expref: 21 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.337993:0:7958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.338042:0:7958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca66 expref: 21 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.338078:0:7958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca66 expref: 21 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.338095:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025227520:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658496.338192:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83392840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658496.345759:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658496.345843:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001062272 00000100:00100000:3.0:1788658496.345857:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001062272 00010000:00010000:3.0:1788658496.345922:0:6522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca66 expref: 22 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658496.345969:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 106 00000100:00100000:3.0:1788658496.345982:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:2397:x1875544001062272:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658496.346004:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658496.346013:0:6522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca66 expref: 22 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.346029:0:6522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca66 expref: 22 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.346058:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658496.346065:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f84b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca89 expref: 22 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.346077:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.346086:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.346095:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.346142:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658496.346221:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:2397:x1875544001062272:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 241us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658496.346228:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 106 00010000:00010000:2.0:1788658496.347781:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670c00/0x48e67cc629c6f7e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca66 expref: 21 pid: 6537 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.347824:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025227520:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658496.347856:0:7958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.347867:0:7958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.347872:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.348120:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.348137:0:7958:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f8b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaa5 expref: 21 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.348146:0:7958:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.348204:0:7958:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f8b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaa5 expref: 21 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.348241:0:7958:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f8b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaa5 expref: 21 pid: 6536 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.348258:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025227648:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658496.348380:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83392e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658496.353503:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658496.353743:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025227648:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658496.353781:0:7958:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658496.358308:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001062400 00000100:00100000:0.0:1788658496.358331:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001062400 00010000:00010000:0.0:1788658496.359060:0:6521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f8b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaa5 expref: 22 pid: 6536 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658496.359122:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 107 00000100:00100000:0.0:1788658496.359138:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:2396:x1875544001062400:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658496.359160:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658496.359169:0:6521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f8b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaa5 expref: 22 pid: 6536 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.359302:0:6521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f8b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaa5 expref: 22 pid: 6536 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.359331:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670a00/0x48e67cc629c6f8b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaa5 expref: 22 pid: 6536 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.359353:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:0.0:1788658496.359360:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.359371:0:6521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.359399:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.359944:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658496.360039:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:2396:x1875544001062400:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 903us (6546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.360049:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 107 00010000:00010000:2.0:1788658496.366017:0:7958:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.366042:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658496.366480:0:7958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788658496.367313:0:7958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788658496.367366:0:7958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788658496.367682:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7958:1875544025227776:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788658496.368313:0:7958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658496.368421:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83392240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658496.368520:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025227776 00000100:00100000:0.0:1788658496.368532:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025227776 00000100:00100000:0.0:1788658496.369116:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788658496.369129:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7958:x1875544025227776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788658496.369278:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7958:x1875544025227776:12345-0@lo:1000:mdt00_003.0 Request processed in 152us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.369286:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788658496.369371:0:7958:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1788658496.369379:0:7958:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:3.0:1788658496.369440:0:7958:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1eb7400e00, transno 4294967322 00000004:00080000:3.0:1788658496.369456:0:7958:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1eb7401c00, transno 4294967323 00000100:00100000:3.0:1788658496.369466:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7958:1875544025227776:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788658496.369682:0:7958:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788658496.369816:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2253800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7958:1875544025227904:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788658496.369858:0:7958:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658496.370771:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658496.370992:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025227904 00000100:00100000:2.0:1788658496.371003:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025227904 00000100:00100000:2.0:1788658496.371054:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788658496.371062:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7958:x1875544025227904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788658496.371367:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7958:x1875544025227904:12345-0@lo:1000:mdt00_003.0 Request processed in 305us (1507us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788658496.371404:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788658496.372026:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2253800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7958:1875544025227904:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788658496.372085:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372098:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372107:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372114:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658496.372119:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372128:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372157:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:3.0:1788658496.372160:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658496.372166:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372185:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f901 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372214:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372221:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372227:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372232:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658496.372234:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372240:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372247:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658496.372249:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658496.372257:0:7958:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f84b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca89 expref: 24 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372270:0:7958:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f84b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca89 expref: 24 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372286:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f84b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca89 expref: 24 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.372331:0:7958:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f84b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca89 expref: 24 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658496.372349:0:7958:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025228032:192.168.202.53@tcp:105: 00000100:00100000:3.0:1788658496.372677:0:7958:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658496.378403:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658496.378525:0:7958:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7958:1875544025228032:192.168.202.53@tcp:105: 00010000:00010000:3.0:1788658496.378566:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378579:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f844 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378624:0:7958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f908 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378642:0:7958:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f908 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378657:0:7958:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f908 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378669:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f908 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378676:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f908 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378740:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f908 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378748:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658496.378752:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f908 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378760:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f908 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378774:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658496.378777:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658496.378781:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f908 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378787:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f908 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378798:0:7958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378804:0:7958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378810:0:7958:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378815:0:7958:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658496.378818:0:7958:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378835:0:7958:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378845:0:7958:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658496.378848:0:7958:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788658496.378851:0:7958:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.378857:0:7958:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f8fa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7958 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658496.379071:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12462:x1875544001062144:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 41243us (41550us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788658496.379084:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 247 00000020:00080000:3.0:1788658496.379092:0:7958:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788658496.379205:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001062528 00000100:00100000:2.0:1788658496.379214:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001062528 00000100:00100000:2.0:1788658496.379270:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:2.0:1788658496.379281:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12461:x1875544001062528:12345-192.168.202.53@tcp:49:lfs.0 00000100:00100000:2.0:1788658496.379400:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12461:x1875544001062528:12345-192.168.202.53@tcp:49:lfs.0 Request processed in 121us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658496.379407:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00000040:00080000:0.0:1788658496.379680:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658496.379686:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658496.380237:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788658496.380254:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788658496.391015:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658496.391068:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658496.391384:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001063040 00000100:00100000:3.0:1788658496.391397:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001063040 00000100:00100000:3.0:1788658496.391472:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 248 00000100:00100000:3.0:1788658496.391482:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12461:x1875544001063040:12345-192.168.202.53@tcp:58:lfs.0 00000040:00080000:3.0:1788658496.391692:0:6538:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788658496.391820:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12461:x1875544001063040:12345-192.168.202.53@tcp:58:lfs.0 Request processed in 338us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658496.391829:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 248 00000100:00100000:1.0:1788658496.392028:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001062784 00000100:00100000:1.0:1788658496.392033:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001062784 00000100:00100000:1.0:1788658496.392064:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:1.0:1788658496.392070:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb55c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+24:12462:x1875544001062784:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788658496.392276:0:6540:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788658496.392313:0:6540:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1788658496.392348:0:6540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.392368:0:6540:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.392383:0:6540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.392393:0:6540:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.392402:0:6540:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.392436:0:6540:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.392465:0:6540:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788658496.392523:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb55c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:12462:x1875544001062784:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 453us (1525us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1788658496.392529:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 62 00000020:00080000:1.0:1788658496.392541:0:6540:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788658496.393306:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658496.393316:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.393325:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658496.393342:0:7486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.393352:0:7486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.393369:0:7486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:3.0:1788658496.393373:0:7486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788658496.393378:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.393385:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83418a00/0x48e67cc629c6f90f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6540 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658496.393401:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658496.393403:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658496.393413:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658496.445080:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658496.445187:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001063168 00000100:00100000:2.0:1788658496.445198:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001063168 00000100:00100000:2.0:1788658496.445268:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 249 00000100:00100000:2.0:1788658496.445280:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+26:12464:x1875544001063168:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658496.445315:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658496.445344:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f916 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccac1 expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.445435:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f91d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.445454:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f91d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.445469:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f91d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.445487:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f924 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.445518:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.445526:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.445640:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.445652:0:6536:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca82 expref: 27 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.445661:0:6536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658496.447336:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025228672:0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.447671:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025228544:0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.447770:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658496.447836:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025229056:0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.447863:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658496.447899:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025229568:0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.447925:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658496.448000:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025229056 00000100:00100000:0.0:1788658496.448010:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025229056 00000100:00080000:0.0:1788658496.448041:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658496.448090:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788658496.448101:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025229056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.448166:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025229056:12345-0@lo:400:kworker.0 Request processed in 67us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.448174:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00080000:0.0:1788658496.448219:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb2253480 x1875544025229056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658496.448236:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025229056:0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.448288:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025228544 00000100:00100000:0.0:1788658496.448292:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025228544 00000100:00100000:0.0:1788658496.448321:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788658496.448328:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025228544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.448367:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025228544:12345-0@lo:400:kworker.0 Request processed in 40us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.448373:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788658496.448398:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025228544:0@lo:400:kworker.0 00000100:00100000:1.0:1788658496.448503:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025228288:0@lo:400:kworker.0 00000100:00100000:1.0:1788658496.448544:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658496.448576:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025228800:0@lo:400:kworker.0 00000100:00100000:1.0:1788658496.448601:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658496.448618:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025229312:0@lo:400:kworker.0 00000100:00100000:1.0:1788658496.448640:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658496.448661:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788658496.448668:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025228416:0@lo:400:kworker.0 00000100:00100000:1.0:1788658496.448691:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658496.448741:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025228928:0@lo:400:kworker.0 00000100:00100000:1.0:1788658496.448764:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658496.448782:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025229440:0@lo:400:kworker.0 00000100:00100000:1.0:1788658496.448804:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658496.448814:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025229312 00000100:00100000:1.0:1788658496.448833:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025228416 00000100:00100000:1.0:1788658496.448836:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025228416 00000100:00100000:1.0:1788658496.448860:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025228928 00000100:00100000:1.0:1788658496.448872:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025228928 00000100:00100000:3.0:1788658496.448873:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025229312 00000100:00100000:1.0:1788658496.448910:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025229440 00000100:00100000:3.0:1788658496.448913:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788658496.448914:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025229440 00000100:00100000:3.0:1788658496.448919:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025228416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658496.448933:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788658496.448938:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025228928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658496.448962:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025228416:12345-0@lo:400:kworker.0 Request processed in 42us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658496.448966:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025228928:12345-0@lo:400:kworker.0 Request processed in 28us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658496.448969:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788658496.448972:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788658496.448983:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788658496.448986:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788658496.448989:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025229312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658496.448992:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025229440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658496.449014:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025229440:12345-0@lo:400:kworker.0 Request processed in 22us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658496.449014:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025229312:12345-0@lo:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658496.449020:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788658496.449029:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00080000:1.0:1788658496.449038:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658496.449041:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658496.449050:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025228800 00000100:00100000:1.0:1788658496.449052:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025228800 00000100:00100000:3.0:1788658496.449053:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025228416:0@lo:400:kworker.0 00000100:00100000:3.0:1788658496.449062:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025228928:0@lo:400:kworker.0 00010000:00080000:3.0:1788658496.449072:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3c380 x1875544025229440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658496.449076:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788658496.449082:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025229440:0@lo:400:kworker.0 00000100:00100000:1.0:1788658496.449083:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025228800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658496.449092:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025229312:0@lo:400:kworker.0 00000100:00100000:3.0:1788658496.449112:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025228800:0@lo:400:kworker.0 00000100:00100000:1.0:1788658496.449112:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025228800:12345-0@lo:400:kworker.0 Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658496.449118:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788658496.449128:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658496.449150:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025229184:0@lo:400:kworker.0 00000100:00100000:3.0:1788658496.449179:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658496.449261:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025228288 00000100:00100000:0.0:1788658496.449265:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025228288 00000100:00100000:0.0:1788658496.449301:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788658496.449309:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025228288:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1788658496.449365:0:6536:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca82 expref: 27 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658496.449385:0:6536:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca82 expref: 27 pid: 7958 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658496.449402:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875544025228160:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658496.449516:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadbda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025228288:12345-0@lo:400:kworker.0 Request processed in 208us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.449524:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788658496.449567:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025229824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658496.449591:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658496.451113:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025229696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658496.451200:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658496.451277:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025229824 00000100:00100000:2.0:1788658496.451286:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025229824 00000100:00100000:2.0:1788658496.451346:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025229696 00000100:00100000:2.0:1788658496.451350:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025229696 00000100:00100000:2.0:1788658496.451414:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788658496.451422:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025229824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658496.451452:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1788658496.451501:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025229824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658496.451509:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788658496.451528:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788658496.451534:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025229696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658496.451543:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1788658496.451572:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025229696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658496.451579:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788658496.451595:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658496.451651:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025229696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658496.452567:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025228672 00000100:00100000:2.0:1788658496.452580:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025228672 00000100:00100000:0.0:1788658496.453110:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025228288:0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.453171:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025229824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658496.453213:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025229568 00000100:00100000:0.0:1788658496.453218:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025229568 00000100:00100000:0.0:1788658496.453254:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025229184 00000100:00100000:3.0:1788658496.453256:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d833926c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658496.453257:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025229184 00000100:00100000:0.0:1788658496.453293:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788658496.453302:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025229568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.453379:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025229568:12345-0@lo:400:kworker.0 Request processed in 78us (5451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.453387:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788658496.453407:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788658496.453414:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025229184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.453450:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025229184:12345-0@lo:400:kworker.0 Request processed in 37us (4270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.453456:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788658496.453527:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025229568:0@lo:400:kworker.0 00000100:00080000:2.0:1788658496.453713:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658496.453931:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025229184:0@lo:400:kworker.0 00000100:00100000:2.0:1788658496.453959:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788658496.453967:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025228672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658496.454023:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025228672:12345-0@lo:400:kworker.0 Request processed in 58us (4894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658496.454029:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788658496.454428:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025228672:0@lo:400:kworker.0 00000100:00100000:0.0:1788658496.461155:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658496.461241:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6536:1875544025228160:192.168.202.53@tcp:104: 00010000:00010000:3.0:1788658496.461279:0:6536:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658496.461455:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001063424 00000100:00100000:1.0:1788658496.461465:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001063424 00000100:00100000:1.0:1788658496.461538:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:1.0:1788658496.461550:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:6169:x1875544001063424:12345-192.168.202.53@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788658496.462023:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:6169:x1875544001063424:12345-192.168.202.53@tcp:35:ldlm_bl.0 Request processed in 473us (883us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788658496.462032:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:3.0:1788658496.464670:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658496.465024:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001063552 00000100:00100000:1.0:1788658496.465041:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001063552 00010000:00010000:1.0:1788658496.465095:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca82 expref: 29 pid: 7958 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658496.465154:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 108 00000100:00100000:1.0:1788658496.465166:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:2396:x1875544001063552:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658496.465185:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658496.465194:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca82 expref: 29 pid: 7958 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.465211:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca82 expref: 29 pid: 7958 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.465241:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6f836 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca82 expref: 29 pid: 7958 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.465267:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:1.0:1788658496.465273:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.465286:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.465295:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658496.465355:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658496.465435:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae3ba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:2396:x1875544001063552:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 271us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658496.465443:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 108 00010000:00010000:0.0:1788658496.465990:0:6536:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466001:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658496.466069:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788658496.466085:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658496.466109:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466126:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466137:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f91d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466144:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f91d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466152:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f91d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466158:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658496.466163:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f91d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466171:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f91d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466182:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:0.0:1788658496.466185:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658496.466189:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f91d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466196:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1400/0x48e67cc629c6f91d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466208:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f924 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466223:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f924 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466230:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f924 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466235:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658496.466238:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f924 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466245:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f924 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466253:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8a1d83406900) 00010000:00010000:0.0:1788658496.466255:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658496.466258:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f924 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466265:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0600/0x48e67cc629c6f924 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466313:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1200/0x48e67cc629c6f916 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccac1 expref: 28 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466328:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccac1 expref: 27 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658496.466337:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:0.0:1788658496.466340:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658496.466349:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0400, rc 0) 00000100:00100000:0.0:1788658496.466404:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12464:x1875544001063168:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 21126us (21337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658496.466413:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 249 00000100:00100000:1.0:1788658496.958935:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025229952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658496.959011:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658496.959128:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025229952 00000100:00100000:2.0:1788658496.959136:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025229952 00000100:00100000:2.0:1788658496.959194:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788658496.959219:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025229952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658496.959250:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658496.959302:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025229952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658496.959310:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788658496.959349:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788658496.959354:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:2.0:1788658496.959377:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1d836fca80, transno 4294967308 00000004:00080000:2.0:1788658496.959389:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788658496.959401:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1d8379aa00, transno 4294967311 00000100:00100000:2.0:1788658496.959412:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025229952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658496.960040:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025230080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658496.960078:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658496.960214:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025230080 00000100:00100000:1.0:1788658496.960220:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025230080 00000100:00100000:1.0:1788658496.960255:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788658496.960263:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025230080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658496.960276:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658496.960311:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025230080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658496.960317:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788658496.960497:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025230080:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788658496.965934:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658497.249779:0:14725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788658497.249804:0:14725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788658497.249843:0:14725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788658497.249849:0:14725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788658497.283218:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788658497.408463:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658497.408471:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658497.408498:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788658497.408505:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788658497.408643:0:13813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025230208:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788658497.408791:0:13813:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb21683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658497.414595:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658497.414634:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001063680 00000100:00100000:3.0:1788658497.414643:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001063680 00000100:00100000:3.0:1788658497.414699:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 250 00000100:00100000:3.0:1788658497.414728:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:12476:x1875544001063680:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788658497.414789:0:11974:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788658497.414899:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:12476:x1875544001063680:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 173us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658497.414904:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 250 00000100:00100000:1.0:1788658497.415295:0:13813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13813:1875544025230208:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788658497.419843:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658497.419986:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001063936 00000100:00100000:2.0:1788658497.419999:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001063936 00000100:00100000:2.0:1788658497.420084:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 251 00000100:00100000:2.0:1788658497.420095:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+27:12476:x1875544001063936:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658497.420117:0:6537:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658497.420138:0:6537:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f932 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccac8 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658497.420248:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658497.420262:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658497.420289:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658497.420301:0:6537:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788658497.420405:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f932 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccac8 expref: 30 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658497.420425:0:6537:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccac8 expref: 29 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658497.420434:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658497.420437:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658497.420440:0:6537:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1a00, rc 0) 00000100:00100000:2.0:1788658497.420506:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12476:x1875544001063936:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 413us (814us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788658497.420513:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 251 00000100:00100000:3.0:1788658497.424145:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658497.424227:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001064064 00000100:00100000:2.0:1788658497.424238:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001064064 00000100:00100000:2.0:1788658497.424339:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1788658497.424349:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:2397:x1875544001064064:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658497.424364:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658497.424398:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccac8 expref: 29 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658497.424416:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:2.0:1788658497.424421:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658497.424495:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:2397:x1875544001064064:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658497.424503:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1788658497.425558:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658497.425645:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001064320 00000100:00100000:0.0:1788658497.425651:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001064320 00000100:00100000:0.0:1788658497.425860:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 252 00000100:00100000:0.0:1788658497.425871:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+28:12476:x1875544001064320:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788658497.425954:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f947 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.425971:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f947 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.425984:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f947 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.426148:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f947 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.426169:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f947 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.426177:0:6536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f947 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.426184:0:6536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658497.426189:0:6536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f947 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.426197:0:6536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f947 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.426208:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:0.0:1788658497.426211:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658497.426215:0:6536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f947 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658497.426221:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c6f947 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658497.426520:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12476:x1875544001064320:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 648us (964us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788658497.426529:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 252 00000040:00080000:1.0:1788658497.426857:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658497.426862:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658497.427370:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788658497.427531:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788658497.432998:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658497.433070:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001064576 00000100:00100000:2.0:1788658497.433082:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001064576 00000100:00100000:2.0:1788658497.433144:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:2.0:1788658497.433155:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+29:12476:x1875544001064576:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788658497.437050:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:12476:x1875544001064576:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 3884us (4342us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788658497.437065:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 64 00000100:00100000:1.0:1788658497.471418:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658497.471442:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025230336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658497.471521:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658497.471682:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025230336 00000100:00100000:2.0:1788658497.471690:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025230336 00000100:00100000:2.0:1788658497.471777:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788658497.471787:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025230336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658497.471819:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788658497.471867:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025230336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658497.471875:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788658497.472016:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025230336:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658497.982867:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658498.747469:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658498.747533:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658498.747569:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658498.747601:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658498.747633:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658498.747657:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658498.747690:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658498.747752:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001064832 00000100:00100000:3.0:1788658498.747761:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001064832 00000100:00100000:3.0:1788658498.747813:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001065344 00000100:00100000:3.0:1788658498.747816:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001065344 00000100:00100000:3.0:1788658498.747828:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001064960 00000100:00100000:3.0:1788658498.747831:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001064960 00000100:00100000:3.0:1788658498.747843:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001065472 00000100:00100000:3.0:1788658498.747845:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001065472 00000100:00100000:3.0:1788658498.747862:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 354 00000100:00100000:3.0:1788658498.747871:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:2397:x1875544001064832:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658498.747958:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:2397:x1875544001064832:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 88us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658498.747976:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 354 00000100:00100000:3.0:1788658498.747994:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 355 00000100:00100000:3.0:1788658498.748000:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544001065344:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658498.748024:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544001065344:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658498.748030:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 355 00000100:00100000:3.0:1788658498.748042:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 356 00000100:00100000:3.0:1788658498.748047:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544001064960:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658498.748070:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544001064960:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658498.748075:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 356 00000100:00100000:3.0:1788658498.748084:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 357 00000100:00100000:3.0:1788658498.748090:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544001065472:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658498.748107:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2397:x1875544001065472:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 18us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658498.748113:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 357 00000100:00100000:3.0:1788658498.748128:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001064704 00000100:00100000:3.0:1788658498.748131:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001064704 00000100:00100000:3.0:1788658498.748154:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 394 00000100:00100000:3.0:1788658498.748161:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544001064704:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658498.748182:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+13:2397:x1875544001064704:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658498.748188:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 394 00000100:00080000:3.0:1788658498.748226:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658498.748230:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658498.749443:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001065088 00000100:00100000:0.0:1788658498.749458:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001065088 00000100:00100000:0.0:1788658498.749538:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001065216 00000100:00100000:0.0:1788658498.749542:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001065216 00000100:00100000:0.0:1788658498.749590:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:0.0:1788658498.749601:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544001065088:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658498.749679:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2397:x1875544001065088:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 81us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658498.749685:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:0.0:1788658498.749729:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 133 00000100:00100000:0.0:1788658498.749736:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001065216:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658498.749760:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001065216:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658498.749767:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 133 00000100:00080000:3.0:1788658498.751398:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658498.751408:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788658499.008483:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658499.226161:0:14776:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788658499.226169:0:14776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658499.226192:0:14776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788658499.226197:0:14776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788658499.450583:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658499.450748:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001065728 00000100:00100000:3.0:1788658499.450759:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001065728 00000100:00100000:3.0:1788658499.451495:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 253 00000100:00100000:3.0:1788658499.451508:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+30:12496:x1875544001065728:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658499.451534:0:6538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658499.454007:0:6538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f94e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccacf expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.454841:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f955 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.454860:0:6538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f955 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.454873:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f955 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658499.454886:0:6538:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788658499.455017:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96e00/0x48e67cc629c6f94e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccacf expref: 33 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.455049:0:6538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f955 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccacf expref: 32 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.455059:0:6538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658499.455077:0:6538:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788658499.455081:0:6538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97400, rc 0) 00000100:00100000:3.0:1788658499.455154:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:12496:x1875544001065728:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 3648us (4578us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788658499.455163:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 253 00000100:00100000:2.0:1788658499.459780:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658499.462586:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001065856 00000100:00100000:3.0:1788658499.462601:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001065856 00000100:00100000:3.0:1788658499.462682:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 254 00000100:00100000:3.0:1788658499.462694:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:12496:x1875544001065856:12345-192.168.202.53@tcp:54:lfs.0 00010000:00010000:3.0:1788658499.462777:0:11974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f963 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.462795:0:11974:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.462807:0:11974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.462842:0:11974:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f963 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.462850:0:11974:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f963 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.462857:0:11974:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.462863:0:11974:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658499.462868:0:11974:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f963 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.462887:0:11974:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f963 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.462901:0:11974:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658499.462905:0:11974:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658499.462910:0:11974:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f963 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658499.462917:0:11974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96800/0x48e67cc629c6f963 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11974 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658499.463008:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+32:12496:x1875544001065856:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 316us (3238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658499.463017:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 254 00000100:00100000:3.0:1788658499.630892:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658499.631133:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001065984 00000100:00100000:2.0:1788658499.631144:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001065984 00000100:00100000:2.0:1788658499.631324:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:2.0:1788658499.631338:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2397:x1875544001065984:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:2.0:1788658499.631532:0:13833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658499.631556:0:13833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c6f96a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccad6 expref: -99 pid: 13833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658499.631599:0:13833:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9cc33e, atime: 0x6a9cc33e, ctime: 0x6a9cc33e, blocks: 0x8 00010000:00010000:2.0:1788658499.631619:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1788658499.631624:0:13833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658499.631633:0:13833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c6f96a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccad6 expref: 8 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.631651:0:13833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c6f96a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccad6 expref: 8 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658499.631662:0:13833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1e00, rc 0) 00000100:00100000:2.0:1788658499.631786:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2397:x1875544001065984:12345-192.168.202.53@tcp:101:cat.0 Request processed in 452us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658499.631795:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 79 00000100:00100000:1.0:1788658499.636187:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658499.636370:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001066112 00000100:00100000:3.0:1788658499.636437:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001066112 00002000:00100000:3.0:1788658499.636489:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8a1eadba1f80 x1875544001066112/t0(0) o3->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:90/0 lens 488/0 e 0 to 0 dl 1788658510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788658499.636501:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1eadba1f80 with x1875544001066112 ext(0->4095) 00002000:00010000:3.0:1788658499.636508:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1eadba1f80 00000100:00100000:3.0:1788658499.636633:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:3.0:1788658499.636644:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001066112:12345-192.168.202.53@tcp:3:cat.0 00000100:00100000:3.0:1788658499.636841:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+8:2396:x1875544001066112:12345-192.168.202.53@tcp:3:cat.0 Request processed in 197us (664us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788658499.636849:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00002000:00100000:3.0:1788658499.636858:0:8457:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8a1eadba1f80 x1875544001066112/t0(0) o3->8cbe5c26-08aa-4214-8c09-2005fb4b10e9@192.168.202.53@tcp:90/0 lens 488/4536 e 0 to 0 dl 1788658510 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788658499.636879:0:8457:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a1eadba1f80 with x1875544001066112 ext(0->4095) 00002000:00010000:3.0:1788658499.636883:0:8457:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a1eadba1f80 00010000:00010000:3.0:1788658500.031131:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658500.034442:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025230464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658500.034551:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658500.034683:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025230464 00000100:00100000:1.0:1788658500.034692:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025230464 00000100:00100000:1.0:1788658500.034778:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788658500.034802:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025230464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658500.034840:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788658500.053243:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025230464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 18433us (18680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658500.053258:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788658500.059281:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025230464:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788658501.055838:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658501.567183:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025230720:0@lo:400:kworker.0 00000100:00100000:0.0:1788658501.567724:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025230976:0@lo:400:kworker.0 00000100:00100000:2.0:1788658501.568175:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025230848:0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.568303:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025230592:0@lo:400:kworker.0 00000100:00100000:0.0:1788658501.570057:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658501.570135:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025231488:0@lo:400:kworker.0 00000100:00100000:0.0:1788658501.570173:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658501.570195:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025232000:0@lo:400:kworker.0 00000100:00100000:0.0:1788658501.570217:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658501.570321:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025231488 00000100:00100000:0.0:1788658501.570353:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025231488 00000100:00100000:0.0:1788658501.570411:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025232000 00000100:00100000:0.0:1788658501.570414:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025232000 00000100:00100000:0.0:1788658501.570435:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788658501.570443:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025231488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658501.570503:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025231488:12345-0@lo:400:kworker.0 Request processed in 60us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658501.570511:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788658501.570532:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788658501.570537:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025232000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658501.570565:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025232000:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658501.570571:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788658501.570591:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658501.570594:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658501.570631:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025231488:0@lo:400:kworker.0 00000100:00100000:0.0:1788658501.570643:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025232000:0@lo:400:kworker.0 00000100:00100000:0.0:1788658501.570994:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025230976 00000100:00100000:0.0:1788658501.571000:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025230976 00000100:00100000:0.0:1788658501.571033:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788658501.571040:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025230976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658501.571079:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025230976:12345-0@lo:400:kworker.0 Request processed in 40us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658501.571085:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788658501.571112:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025230976:0@lo:400:kworker.0 00000001:00080000:0.0:1788658501.574039:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788658501.574083:0:6515:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a1e9812b180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788658501.574088:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1eae2b5e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a1e9812b0c0 00000020:00080000:0.0:1788658501.574092:0:6515:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a1eae2b5700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a1d83deb600 00000020:00080000:0.0:1788658501.574113:0:6515:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788658501.574138:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788658501.574193:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788658501.574215:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.574226:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.574234:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.574561:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81671a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658501.574567:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.574579:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.574595:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8a1e83b21300) 00010000:00010000:0.0:1788658501.574598:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658501.574603:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658501.574610:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81671a00/0x48e67cc629c6f8e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6538 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658501.574825:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658501.574870:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025231360:0@lo:400:kworker.0 00000100:00100000:2.0:1788658501.574907:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658501.575007:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025231872:0@lo:400:kworker.0 00000100:00100000:2.0:1788658501.575031:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658501.575058:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025231360 00000100:00100000:2.0:1788658501.575065:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025231360 00000100:00100000:2.0:1788658501.575116:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025231872 00000100:00100000:2.0:1788658501.575119:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025231872 00000100:00100000:2.0:1788658501.575141:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788658501.575157:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025231360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658501.575205:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025231360:12345-0@lo:400:kworker.0 Request processed in 49us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658501.575211:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788658501.575227:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788658501.575232:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025231872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658501.575342:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025231872:12345-0@lo:400:kworker.0 Request processed in 108us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658501.575348:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00080000:2.0:1788658501.575364:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788658501.575387:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d55500 x1875544025231872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658501.575400:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025231872:0@lo:400:kworker.0 00000100:00100000:2.0:1788658501.575419:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025232384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658501.575441:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788658501.575462:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83d54380 x1875544025231360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658501.575547:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025231360:0@lo:400:kworker.0 00000100:00100000:2.0:1788658501.575558:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658501.575564:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025232256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658501.575586:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658501.575606:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025232384 00000100:00100000:2.0:1788658501.575609:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025232384 00000100:00100000:2.0:1788658501.575629:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025232256 00000100:00100000:2.0:1788658501.575631:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025232256 00000100:00100000:2.0:1788658501.575651:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788658501.575656:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025232384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658501.575677:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788658501.575722:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025232384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658501.575728:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788658501.575738:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788658501.575743:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025232256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658501.575750:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788658501.575768:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025232256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 25us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658501.575773:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1788658501.575782:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658501.575800:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025232256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658501.575812:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025232384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658501.575859:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025230848 00000100:00100000:2.0:1788658501.575862:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025230848 00000100:00100000:2.0:1788658501.575885:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788658501.575891:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025230848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658501.575925:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025230848:12345-0@lo:400:kworker.0 Request processed in 35us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658501.576057:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658501.576080:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025230592 00000100:00100000:1.0:1788658501.576084:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025230592 00000100:00100000:1.0:1788658501.576109:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788658501.576114:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025230592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.576140:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3648:x1875544025230592:12345-0@lo:400:kworker.0 Request processed in 27us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658501.576146:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788658501.576180:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025230592:0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.576187:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025231104:0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.576208:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658501.576227:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025231104 00000100:00100000:1.0:1788658501.576231:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025231104 00000100:00100000:1.0:1788658501.576256:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788658501.576263:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025231104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.576291:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025231104:12345-0@lo:400:kworker.0 Request processed in 29us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658501.576306:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788658501.576327:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025231104:0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.576341:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025231616:0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.576365:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658501.576387:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025231616 00000100:00100000:1.0:1788658501.576390:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025231616 00000100:00100000:1.0:1788658501.576422:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788658501.576429:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025231616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.576457:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025231616:12345-0@lo:400:kworker.0 Request processed in 29us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658501.576463:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1788658501.576483:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658501.576501:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025231616:0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.576507:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025232128:0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.576528:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658501.576549:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025232128 00000100:00100000:1.0:1788658501.576553:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025232128 00000100:00100000:1.0:1788658501.576574:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788658501.576579:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025232128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658501.576606:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875544025232128:12345-0@lo:400:kworker.0 Request processed in 27us (77us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658501.576612:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788658501.576638:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025232128:0@lo:400:kworker.0 00000100:00100000:2.0:1788658501.577345:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788658501.577386:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025230848:0@lo:400:kworker.0 00000001:00080000:0.0:1788658501.580782:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:0.0:1788658501.580806:0:9530:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:3.0:1788658501.580886:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658501.581020:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025230720 00000100:00100000:0.0:1788658501.581028:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025230720 00000100:00100000:0.0:1788658501.581070:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788658501.581079:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025230720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658501.581150:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025230720:12345-0@lo:400:kworker.0 Request processed in 72us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658501.581158:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788658501.581224:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025230720:0@lo:400:kworker.0 00000100:00100000:3.0:1788658501.581234:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025231232:0@lo:400:kworker.0 00000100:00100000:3.0:1788658501.581340:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658501.581369:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025231744:0@lo:400:kworker.0 00000100:00100000:3.0:1788658501.581390:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658501.581429:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025231232 00000100:00100000:3.0:1788658501.581433:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025231232 00000100:00100000:3.0:1788658501.581466:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025231744 00000100:00100000:3.0:1788658501.581469:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025231744 00000100:00100000:3.0:1788658501.581486:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788658501.581492:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025231232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658501.581525:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025231232:12345-0@lo:400:kworker.0 Request processed in 33us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658501.581532:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788658501.581544:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788658501.581550:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025231744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658501.581667:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025231744:12345-0@lo:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658501.581685:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00080000:3.0:1788658501.581772:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658501.581794:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025231232:0@lo:400:kworker.0 00000100:00100000:3.0:1788658501.581805:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025231744:0@lo:400:kworker.0 00010000:00010000:3.0:1788658502.079011:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658502.079047:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025232512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658502.079125:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658502.084352:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025232512 00000100:00100000:3.0:1788658502.084368:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025232512 00000100:00100000:3.0:1788658502.084435:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788658502.084446:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025232512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658502.084483:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658502.085380:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025232640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658502.085429:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658502.085791:0:8456:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788658502.085802:0:8456:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788658502.086072:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025232640 00000100:00100000:2.0:1788658502.086080:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025232640 00000100:00100000:1.0:1788658502.087444:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788658502.087463:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025232640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658502.087501:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658502.087902:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025232640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 446us (2470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658502.087911:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788658502.088000:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025232640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658502.089344:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025232512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4893us (10211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658502.089354:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788658502.090411:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025232512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658502.593160:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658502.593205:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025232768:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658502.593306:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658502.593393:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025232768 00000100:00100000:0.0:1788658502.593404:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025232768 00000100:00100000:0.0:1788658502.593463:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788658502.593475:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025232768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658502.593524:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788658502.595064:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025232768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1581us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658502.595079:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788658502.595202:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025232768:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658503.103351:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658503.867756:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658503.867840:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658503.867880:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658503.867903:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658503.867926:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658503.867946:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658503.867977:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658503.868010:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001066496 00000100:00100000:3.0:1788658503.868022:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001066496 00000100:00100000:3.0:1788658503.868103:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001067008 00000100:00100000:3.0:1788658503.868107:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001067008 00000100:00100000:3.0:1788658503.868126:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001066368 00000100:00100000:3.0:1788658503.868129:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001066368 00000100:00100000:3.0:1788658503.868302:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001066880 00000100:00100000:3.0:1788658503.868305:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001066880 00000100:00100000:3.0:1788658503.868324:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 364 00000100:00100000:3.0:1788658503.868336:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001066496:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658503.868434:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001066496:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 100us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658503.868443:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 364 00000100:00100000:3.0:1788658503.868463:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 365 00000100:00100000:3.0:1788658503.868469:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001067008:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658503.868492:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001067008:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658503.868498:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 365 00000100:00100000:3.0:1788658503.868508:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 366 00000100:00100000:3.0:1788658503.868514:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:2398:x1875544001066368:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658503.868539:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:2398:x1875544001066368:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658503.868545:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 366 00000100:00100000:3.0:1788658503.868555:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 367 00000100:00100000:3.0:1788658503.868561:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001066880:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658503.868582:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001066880:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 21us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658503.868588:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 367 00000100:00080000:3.0:1788658503.868614:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658503.868618:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658503.868654:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001066752 00000100:00100000:3.0:1788658503.868659:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001066752 00000100:00100000:3.0:1788658503.868692:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001066624 00000100:00100000:3.0:1788658503.868695:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001066624 00000100:00100000:3.0:1788658503.868747:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 138 00000100:00100000:3.0:1788658503.868753:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2398:x1875544001066752:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658503.868781:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2398:x1875544001066752:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 29us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658503.868787:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 138 00000100:00100000:3.0:1788658503.868798:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00100000:3.0:1788658503.868803:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001066624:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658503.868824:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001066624:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 21us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658503.868830:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00080000:3.0:1788658503.868843:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658503.868845:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658503.869193:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001066240 00000100:00100000:0.0:1788658503.869200:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001066240 00000100:00100000:0.0:1788658503.869244:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 396 00000100:00100000:0.0:1788658503.869260:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544001066240:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658503.869310:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1274050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544001066240:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 51us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658503.869317:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 396 00010000:00010000:3.0:1788658504.126861:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658505.152096:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658505.152478:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025232896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658505.152649:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658505.168671:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025232896 00000100:00100000:2.0:1788658505.168692:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025232896 00000100:00100000:2.0:1788658505.168797:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788658505.168811:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025232896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658505.168867:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788658505.168998:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025232896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 189us (16349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.169006:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788658505.169661:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025232896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658505.257096:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658505.257304:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001067136 00000100:00100000:0.0:1788658505.257318:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001067136 00000100:00100000:0.0:1788658505.257433:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 255 00000100:00100000:0.0:1788658505.257448:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:12149:x1875544001067136:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788658505.257601:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:12149:x1875544001067136:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 Request processed in 157us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658505.257609:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 255 00000100:00080000:3.0:1788658505.257686:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658505.262817:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658505.262987:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001067264 00000100:00100000:3.0:1788658505.263001:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001067264 00000100:00080000:0.0:1788658505.263116:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788658505.263208:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 256 00000100:00100000:2.0:1788658505.263223:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:12149:x1875544001067264:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788658505.263606:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:12149:x1875544001067264:12345-192.168.202.53@tcp:60:lhsmtool_posix.0 Request processed in 384us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.263617:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 256 00000100:00100000:1.0:1788658505.267434:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658505.267612:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001067520 00000100:00100000:2.0:1788658505.267626:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001067520 00000100:00100000:2.0:1788658505.267747:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:2.0:1788658505.267761:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:12149:x1875544001067520:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788658505.268089:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:12149:x1875544001067520:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 330us (670us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788658505.268097:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 65 00000100:00100000:3.0:1788658505.559650:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658505.559990:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001067648 00000100:00100000:2.0:1788658505.560024:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001067648 00000100:00100000:2.0:1788658505.560196:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 257 00000100:00100000:2.0:1788658505.560208:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+5:12953:x1875544001067648:12345-192.168.202.53@tcp:101:lsof.0 00010000:00010000:2.0:1788658505.560236:0:6536:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658505.560265:0:6536:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f971 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccadd expref: -99 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.560391:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f978 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.560410:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.560426:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658505.560488:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788658505.560492:0:6536:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658505.560521:0:6536:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f978 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.560550:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0a00/0x48e67cc629c6f971 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccadd expref: 7 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.560571:0:6536:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f978 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccadd expref: 6 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658505.560581:0:6536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e7ef00) 00010000:00010000:2.0:1788658505.560584:0:6536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658505.560588:0:6536:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1a00, rc 0) 00000100:00100000:2.0:1788658505.560664:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+6:12953:x1875544001067648:12345-192.168.202.53@tcp:101:lsof.0 Request processed in 457us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658505.560671:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 257 00000100:00080000:0.0:1788658505.564646:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788658506.175915:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658506.687582:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658506.687612:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025233024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658506.687737:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658506.687835:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025233024 00000100:00100000:1.0:1788658506.687846:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025233024 00000100:00100000:1.0:1788658506.687913:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788658506.687926:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025233024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658506.687964:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788658506.688021:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025233024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658506.688028:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788658506.688167:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025233280:0@lo:400:kworker.0 00000100:00100000:3.0:1788658506.688224:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658506.688325:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025233792:0@lo:400:kworker.0 00000100:00100000:3.0:1788658506.688349:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658506.688364:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025234304:0@lo:400:kworker.0 00000100:00100000:3.0:1788658506.688384:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658506.688511:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025233280 00000100:00100000:2.0:1788658506.688516:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025233280 00000100:00100000:2.0:1788658506.688549:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788658506.688556:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025233280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.688595:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025233280:12345-0@lo:400:kworker.0 Request processed in 40us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658506.688603:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788658506.688662:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025233408:0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.688694:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658506.688761:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025233920:0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.688783:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658506.688801:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025234432:0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.688822:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658506.688855:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025233408 00000100:00100000:2.0:1788658506.688860:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025233408 00000100:00100000:2.0:1788658506.688886:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025233920 00000100:00100000:2.0:1788658506.688888:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025233920 00000100:00100000:2.0:1788658506.688920:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025234432 00000100:00100000:2.0:1788658506.688924:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025234432 00000100:00100000:2.0:1788658506.688942:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788658506.688948:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025233408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.688987:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025233408:12345-0@lo:400:kworker.0 Request processed in 39us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658506.688993:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788658506.689015:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788658506.689021:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025233920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.689048:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025233920:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658506.689054:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788658506.689065:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788658506.689070:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025234432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.689094:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025234432:12345-0@lo:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658506.689099:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788658506.689143:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025233408:0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.689154:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025233920:0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.689166:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025234432:0@lo:400:kworker.0 00000100:00100000:0.0:1788658506.689876:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025233792 00000100:00100000:0.0:1788658506.689886:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025233792 00000100:00100000:0.0:1788658506.689938:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788658506.689947:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025233792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658506.690013:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025233792:12345-0@lo:400:kworker.0 Request processed in 68us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658506.690021:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:0.0:1788658506.690058:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658506.690063:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658506.690097:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025233152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658506.690140:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658506.690172:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025233664:0@lo:400:kworker.0 00000100:00100000:0.0:1788658506.690197:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658506.690215:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025234176:0@lo:400:kworker.0 00000100:00100000:0.0:1788658506.690257:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025233152 00000100:00100000:0.0:1788658506.690261:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025233152 00000100:00100000:2.0:1788658506.690566:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025233664 00000100:00100000:2.0:1788658506.690570:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025233664 00000100:00100000:2.0:1788658506.690604:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788658506.690610:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025233664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.690654:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025233664:12345-0@lo:400:kworker.0 Request processed in 44us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658506.690661:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:2.0:1788658506.690763:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658506.691216:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025233536:0@lo:400:kworker.0 00000100:00100000:1.0:1788658506.691265:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658506.691290:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025234048:0@lo:400:kworker.0 00000100:00100000:1.0:1788658506.691311:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658506.691328:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025234560:0@lo:400:kworker.0 00000100:00100000:1.0:1788658506.691346:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658506.691381:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025233536 00000100:00100000:1.0:1788658506.691386:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025233536 00000100:00100000:1.0:1788658506.693730:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788658506.694881:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025233536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658506.695095:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025233536:12345-0@lo:400:kworker.0 Request processed in 1349us (3828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658506.695131:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788658506.695170:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025233280:0@lo:400:kworker.0 00000100:00100000:3.0:1788658506.695189:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025233792:0@lo:400:kworker.0 00000100:00100000:1.0:1788658506.695191:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025234304 00000100:00100000:1.0:1788658506.695200:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025234304 00000100:00100000:1.0:1788658506.695267:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788658506.695275:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025234304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658506.695319:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025234304:12345-0@lo:400:kworker.0 Request processed in 45us (6933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658506.695325:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1788658506.695357:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658506.695383:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025233536:0@lo:400:kworker.0 00000100:00100000:3.0:1788658506.695394:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025234304:0@lo:400:kworker.0 00000100:00100000:1.0:1788658506.695414:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025234048 00000100:00100000:1.0:1788658506.695418:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025234048 00000100:00100000:1.0:1788658506.695453:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025234560 00000100:00100000:1.0:1788658506.695457:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025234560 00000100:00100000:1.0:1788658506.695479:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788658506.695486:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025234048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658506.695522:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025234048:12345-0@lo:400:kworker.0 Request processed in 38us (4210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658506.695526:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788658506.695530:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788658506.695534:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025234560:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788658506.695542:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788658506.695562:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb9a300 x1875544025234048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658506.695568:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025234560:12345-0@lo:400:kworker.0 Request processed in 36us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658506.695574:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788658506.695575:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025234048:0@lo:400:kworker.0 00010000:00080000:1.0:1788658506.695586:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb99c00 x1875544025234560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658506.695595:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025234560:0@lo:400:kworker.0 00000100:00100000:0.0:1788658506.695733:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788658506.695746:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025233152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658506.695768:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788658506.695810:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025233152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (5670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658506.695816:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788658506.700394:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658506.700498:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025234688:0@lo:400:kworker.0 00000100:00100000:2.0:1788658506.700577:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658506.700641:0:3648:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788658506.700667:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788658506.700741:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025233024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658506.700786:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025233152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658506.700800:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025233664:0@lo:400:kworker.0 00000100:00100000:0.0:1788658506.700824:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025234176 00000100:00100000:0.0:1788658506.700833:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025234176 00000100:00100000:0.0:1788658506.700907:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025234688 00000100:00100000:0.0:1788658506.700910:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025234688 00000100:00100000:0.0:1788658506.700938:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788658506.700949:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025234176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658506.701010:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025234176:12345-0@lo:400:kworker.0 Request processed in 64us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658506.701018:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788658506.701037:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788658506.701042:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025234688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658506.701071:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025234688:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658506.701086:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1788658506.701155:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658506.701183:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025234176:0@lo:400:kworker.0 00000100:00100000:0.0:1788658506.701194:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025234688:0@lo:400:kworker.0 00010000:00010000:3.0:1788658507.199260:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658507.199519:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025234816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658507.199622:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658507.199738:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658507.199746:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025234944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658507.199773:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658507.199857:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025234816 00000100:00100000:2.0:1788658507.199868:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025234816 00000100:00100000:2.0:1788658507.199926:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025234944 00000100:00100000:2.0:1788658507.199929:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025234944 00000100:00100000:2.0:1788658507.199948:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788658507.199958:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025234816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658507.199995:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658507.200050:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025234816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658507.200058:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788658507.200077:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788658507.200084:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025234944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788658507.200093:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658507.200117:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025234944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658507.200123:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788658507.200225:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025234944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658507.200240:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025234816:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788658507.520519:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788658507.646888:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788658507.646897:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658507.647000:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1788658507.647007:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788658507.657848:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:2.0:1788658507.657863:0:6515:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788658507.657955:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788658507.657967:0:6568:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1788658507.711236:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025235072:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658507.712158:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658507.713337:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025235072 00000100:00100000:1.0:1788658507.713356:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025235072 00000100:00100000:1.0:1788658507.713452:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788658507.713466:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025235072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788658507.713516:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788658507.713630:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025235072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (2182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658507.713637:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788658507.714036:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025235072:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788658508.222869:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658508.991796:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658508.991896:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658508.991928:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658508.991975:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658508.991996:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658508.992015:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658508.992047:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658508.992077:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001067904 00000100:00100000:1.0:1788658508.992086:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001067904 00000100:00100000:1.0:1788658508.992141:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001068416 00000100:00100000:1.0:1788658508.992144:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001068416 00000100:00100000:1.0:1788658508.992156:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001068032 00000100:00100000:1.0:1788658508.992158:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001068032 00000100:00100000:1.0:1788658508.992171:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001068544 00000100:00100000:1.0:1788658508.992173:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001068544 00000100:00100000:1.0:1788658508.992201:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 374 00000100:00100000:1.0:1788658508.992211:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:2398:x1875544001067904:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658508.992304:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:2398:x1875544001067904:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 94us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658508.992311:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 374 00000100:00100000:1.0:1788658508.992331:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 375 00000100:00100000:1.0:1788658508.992337:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2398:x1875544001068416:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658508.992360:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2398:x1875544001068416:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658508.992367:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 375 00000100:00100000:1.0:1788658508.992380:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 376 00000100:00100000:1.0:1788658508.992386:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001068032:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658508.992408:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001068032:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 22us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658508.992414:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 376 00000100:00100000:1.0:1788658508.992425:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 377 00000100:00100000:1.0:1788658508.992431:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001068544:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658508.992452:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001068544:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 21us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658508.992458:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 377 00000100:00100000:1.0:1788658508.992475:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001067776 00000100:00100000:1.0:1788658508.992479:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001067776 00000100:00100000:1.0:1788658508.992517:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 398 00000100:00100000:1.0:1788658508.992524:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544001067776:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:1.0:1788658508.992548:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544001067776:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658508.992562:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 398 00000100:00100000:0.0:1788658508.993380:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001068160 00000100:00100000:0.0:1788658508.993389:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001068160 00000100:00100000:3.0:1788658508.993599:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001068288 00000100:00100000:3.0:1788658508.993603:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001068288 00000100:00080000:1.0:1788658508.993686:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658508.993690:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788658508.993693:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658508.993725:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658508.995415:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 143 00000100:00100000:3.0:1788658508.995432:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001068160:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658508.995581:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2398:x1875544001068160:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 156us (3684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658508.995733:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 143 00000100:00100000:3.0:1788658508.995757:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 144 00000100:00100000:3.0:1788658508.995848:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2398:x1875544001068288:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658508.995878:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2398:x1875544001068288:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 33us (3862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658508.995884:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 144 00010000:00010000:3.0:1788658509.248304:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658509.761800:0:14975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:35:07 (1788658507) 00010000:00010000:2.0:1788658510.278400:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658510.283698:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025235200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658510.283816:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658510.284198:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025235200 00000100:00100000:1.0:1788658510.284210:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025235200 00000100:00100000:1.0:1788658510.284314:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788658510.284327:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025235200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658510.284382:0:7782:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788658510.284458:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025235200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658510.284466:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788658510.284539:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025235200:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788658511.303160:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658511.807260:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025235584:0@lo:400:kworker.0 00000100:00100000:1.0:1788658511.807362:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658511.807427:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025236096:0@lo:400:kworker.0 00000100:00100000:1.0:1788658511.807453:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658511.807478:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025236608:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.807584:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025235456:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.807630:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658511.807655:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025235968:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.807678:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658511.807726:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025236480:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.807751:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658511.807781:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788658511.807788:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025235328:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.807822:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658511.807847:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025235840:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.807884:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658511.807905:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025236352:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.807931:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658511.807951:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025236864:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.807975:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658511.808012:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025235584 00000100:00100000:3.0:1788658511.808022:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025235584 00000100:00100000:3.0:1788658511.808075:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025235840 00000100:00100000:3.0:1788658511.808079:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025235840 00000100:00100000:3.0:1788658511.808116:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788658511.808126:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025235584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.808192:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025235584:12345-0@lo:400:kworker.0 Request processed in 67us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658511.808200:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788658511.808222:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788658511.808228:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025235840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.808264:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025235840:12345-0@lo:400:kworker.0 Request processed in 36us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658511.808270:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788658511.808289:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025236096 00000100:00100000:3.0:1788658511.808293:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025236096 00000100:00100000:3.0:1788658511.808337:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025235456 00000100:00100000:3.0:1788658511.808341:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025235456 00000100:00100000:3.0:1788658511.808350:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025235968 00000100:00100000:3.0:1788658511.808353:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025235968 00000100:00100000:3.0:1788658511.808366:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025236480 00000100:00100000:3.0:1788658511.808368:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025236480 00000100:00100000:3.0:1788658511.808384:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788658511.808390:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025236096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.808423:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025236096:12345-0@lo:400:kworker.0 Request processed in 34us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658511.808429:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788658511.808441:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788658511.808446:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025235456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.808475:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025235456:12345-0@lo:400:kworker.0 Request processed in 29us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658511.808655:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788658511.808669:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788658511.808675:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025235968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.808735:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025235968:12345-0@lo:400:kworker.0 Request processed in 60us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658511.808741:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788658511.808753:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788658511.808758:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025236480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.808786:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025236480:12345-0@lo:400:kworker.0 Request processed in 28us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658511.808792:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788658511.808825:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025235328 00000100:00100000:3.0:1788658511.808830:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025235328 00000100:00100000:3.0:1788658511.808861:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788658511.809089:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025235712:0@lo:400:kworker.0 00000100:00100000:0.0:1788658511.809129:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658511.809154:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025236224:0@lo:400:kworker.0 00000100:00100000:0.0:1788658511.809177:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658511.809196:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025236736:0@lo:400:kworker.0 00000100:00100000:0.0:1788658511.809219:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658511.809251:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025236352 00000100:00100000:0.0:1788658511.809256:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025236352 00000100:00100000:0.0:1788658511.809290:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025236864 00000100:00100000:0.0:1788658511.809301:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025236864 00000100:00100000:0.0:1788658511.809321:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025236224 00000100:00100000:0.0:1788658511.809323:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025236224 00000100:00100000:0.0:1788658511.809337:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025236736 00000100:00100000:0.0:1788658511.809339:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025236736 00000100:00100000:0.0:1788658511.809354:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788658511.809359:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025236352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658511.809409:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025236352:12345-0@lo:400:kworker.0 Request processed in 51us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658511.809417:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788658511.809433:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788658511.809438:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025236864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658511.809466:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025236864:12345-0@lo:400:kworker.0 Request processed in 28us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658511.809472:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788658511.809496:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788658511.809502:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025236224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658511.809535:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025236224:12345-0@lo:400:kworker.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658511.809540:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788658511.809551:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788658511.809557:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025236736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658511.809596:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025236736:12345-0@lo:400:kworker.0 Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658511.809602:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788658511.809656:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025236224:0@lo:400:kworker.0 00000100:00100000:0.0:1788658511.809686:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025236736:0@lo:400:kworker.0 00000100:00100000:0.0:1788658511.809755:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025235712 00000100:00100000:0.0:1788658511.809759:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025235712 00000100:00100000:0.0:1788658511.809791:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788658511.809797:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025235712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658511.809837:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025235712:12345-0@lo:400:kworker.0 Request processed in 40us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658511.809842:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788658511.809879:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025235712:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.810725:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025235328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.810790:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1276450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025235328:12345-0@lo:400:kworker.0 Request processed in 89us (2967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658511.810798:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1788658511.811050:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658511.811111:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025235584:0@lo:400:kworker.0 00010000:00080000:1.0:1788658511.811130:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eed180 x1875544025236096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658511.811141:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025236096:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.811235:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025235328:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.811250:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025235840:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.811265:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025236352:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.811278:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025236864:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.811290:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025235456:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.811315:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025235968:0@lo:400:kworker.0 00000100:00100000:3.0:1788658511.811327:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025236480:0@lo:400:kworker.0 00000100:00080000:3.0:1788658511.811358:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788658511.811365:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658511.811368:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658511.811372:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658511.811388:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025236608 00000100:00100000:3.0:1788658511.811395:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025236608 00000100:00100000:3.0:1788658511.811454:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788658511.811462:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025236608:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788658511.811781:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788658511.811983:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025236608:12345-0@lo:400:kworker.0 Request processed in 521us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658511.811991:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788658511.812763:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025236992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658511.812828:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658511.812907:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025236992 00000100:00100000:0.0:1788658511.812914:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025236992 00000100:00100000:0.0:1788658511.812964:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788658511.812973:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025236992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658511.813009:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788658511.813056:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025236992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658511.813063:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788658511.813118:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025236992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658511.815651:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658511.815693:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025237120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658511.815809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658511.816098:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025237120 00000100:00100000:0.0:1788658511.816109:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025237120 00000100:00100000:0.0:1788658511.816184:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788658511.816194:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025237120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658511.816226:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788658511.816283:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025237120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658511.816291:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788658511.816350:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025237120:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788658511.817032:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5eef100 x1875544025236608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658511.817049:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025236608:0@lo:400:kworker.0 00010000:00010000:3.0:1788658512.318955:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658512.319290:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658512.319339:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025237248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658512.319458:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658512.320892:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025237248 00000100:00100000:3.0:1788658512.320915:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025237248 00000100:00100000:3.0:1788658512.321015:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788658512.321038:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025237248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658512.321086:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788658512.321196:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025237248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658512.321205:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788658512.321281:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025237248:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658512.324234:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025237376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658512.324357:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658512.324579:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025237376 00000100:00100000:2.0:1788658512.324591:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025237376 00000100:00100000:2.0:1788658512.324666:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788658512.324678:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025237376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658512.324751:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788658512.324818:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025237376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658512.324826:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788658512.324884:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025237376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658512.831635:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658512.831660:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025237504:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658512.831776:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658512.831890:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025237504 00000100:00100000:0.0:1788658512.831900:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025237504 00000100:00100000:0.0:1788658512.831953:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788658512.831963:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025237504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658512.831997:0:6542:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788658512.832063:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025237504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658512.832070:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788658512.832501:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025237504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658513.269095:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658513.269270:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001068800 00000100:00100000:2.0:1788658513.269280:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001068800 00000100:00100000:2.0:1788658513.269407:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00100000:2.0:1788658513.269420:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+18:13176:x1875544001068800:12345-192.168.202.53@tcp:35:umount.0 00000100:00100000:2.0:1788658513.269686:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:13176:x1875544001068800:12345-192.168.202.53@tcp:35:umount.0 Request processed in 269us (601us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788658513.269741:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 66 00000100:00080000:1.0:1788658513.270630:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658513.279293:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658513.279805:0:13563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001069056 00000100:00100000:2.0:1788658513.279817:0:13563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001069056 00000100:00100000:2.0:1788658513.279885:0:13563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:2.0:1788658513.279896:0:13563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+19:13176:x1875544001069056:12345-192.168.202.53@tcp:35:umount.0 00000100:00100000:2.0:1788658513.280229:0:13563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:13176:x1875544001069056:12345-192.168.202.53@tcp:35:umount.0 Request processed in 333us (945us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788658513.280239:0:13563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 67 00000100:00100000:3.0:1788658513.284847:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658513.284975:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001069312 00000100:00100000:0.0:1788658513.284985:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001069312 00000100:00100000:0.0:1788658513.285044:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:0.0:1788658513.285055:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadb54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+20:13176:x1875544001069312:12345-192.168.202.53@tcp:35:umount.0 00000100:00100000:0.0:1788658513.285319:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadb54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:13176:x1875544001069312:12345-192.168.202.53@tcp:35:umount.0 Request processed in 266us (482us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788658513.285329:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:1.0:1788658513.287781:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658513.288316:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001069568 00000100:00100000:0.0:1788658513.288326:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001069568 00000100:00100000:0.0:1788658513.288384:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:0.0:1788658513.288394:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:13176:x1875544001069568:12345-192.168.202.53@tcp:35:umount.0 00000100:00100000:0.0:1788658513.288682:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:13176:x1875544001069568:12345-192.168.202.53@tcp:35:umount.0 Request processed in 289us (908us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788658513.288691:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:1.0:1788658513.300666:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658513.300739:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658513.300770:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658513.300851:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001070080 00000100:00100000:0.0:1788658513.300861:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001070080 00000100:00100000:0.0:1788658513.300927:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001070336 00000100:00100000:0.0:1788658513.300930:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001070336 00000100:00100000:0.0:1788658513.300955:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001070208 00000100:00100000:0.0:1788658513.300958:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001070208 00000100:00100000:0.0:1788658513.300975:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1788658513.300984:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+15:2398:x1875544001070080:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658513.301000:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658513.301019:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b3600/0x48e67cc629c6e8d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc630 expref: 15 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658513.301034:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658513.301082:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+14:2398:x1875544001070080:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 99us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658513.301089:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:0.0:1788658513.301108:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:0.0:1788658513.301113:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+13:2398:x1875544001070336:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658513.301121:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658513.301130:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83418400/0x48e67cc629c6eb6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc709 expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658513.301139:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658513.301155:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+12:2398:x1875544001070336:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 42us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658513.301176:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:0.0:1788658513.301191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1788658513.301197:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+11:2398:x1875544001070208:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658513.301205:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658513.301215:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80030e00/0x48e67cc629c6e892 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc5f1 expref: 11 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658513.301238:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658513.301257:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+10:2398:x1875544001070208:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 61us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658513.301264:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:2.0:1788658513.302044:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658513.302853:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001069952 00000100:00100000:0.0:1788658513.302865:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001069952 00000100:00100000:0.0:1788658513.302926:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 80 00000100:00100000:0.0:1788658513.302946:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+7:2395:x1875544001069952:12345-192.168.202.53@tcp:9:umount.0 00000020:00000080:0.0:1788658513.302978:0:8452:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6eee3 00000020:00010000:0.0:1788658513.302986:0:8452:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a1e98865000: total 0 00000100:00080000:0.0:1788658513.302991:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8a1e98865800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658513.303039:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788658513.303189:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2395:x1875544001069952:12345-192.168.202.53@tcp:9:umount.0 Request processed in 255us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658513.303198:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 80 00000020:00010000:2.0:1788658513.303327:0:6525:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a1e98865000: total 0 00010000:00010000:2.0:1788658513.303373:0:6525:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a1e98865000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788658513.303429:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e7b989f/0x48e67cc629c6f96a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccad6 expref: 4 pid: 13833 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658513.303466:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d13c77fd/0x48e67cc629c6f29b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8f3 expref: 3 pid: 8454 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658513.303481:0:6525:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a1e98865000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788658513.303494:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658513.303496:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658513.303498:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658513.303556:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658513.312803:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658513.313879:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001070464 00000100:00100000:0.0:1788658513.313903:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001070464 00000100:00100000:0.0:1788658513.313996:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00100000:0.0:1788658513.314007:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2395:x1875544001070464:12345-192.168.202.53@tcp:9:umount.0 00000020:00000080:0.0:1788658513.314051:0:10365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6ec6d 00000100:00080000:0.0:1788658513.314061:0:10365:0:(import.c:65:import_set_state_nolock()) ffff8a1d83703800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658513.314123:0:10365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788658513.314295:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+2:2395:x1875544001070464:12345-192.168.202.53@tcp:9:umount.0 Request processed in 288us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658513.314303:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 81 00000100:00080000:1.0:1788658513.315628:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788658513.316322:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658513.326077:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658513.326197:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001071488 00000100:00100000:0.0:1788658513.326210:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001071488 00000100:00100000:0.0:1788658513.326282:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 258 00000100:00100000:0.0:1788658513.326302:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+22:2395:x1875544001071488:12345-192.168.202.53@tcp:39:umount.0 00000020:00000080:0.0:1788658513.326337:0:6537:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e8a0 00000020:00010000:0.0:1788658513.326355:0:6537:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a1d82762000: total 0 00000100:00080000:0.0:1788658513.326361:0:6537:0:(import.c:65:import_set_state_nolock()) ffff8a1d82764800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658513.326404:0:6537:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1788658513.326528:0:6524:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a1d82762000: total 0 00000100:00100000:0.0:1788658513.326573:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+21:2395:x1875544001071488:12345-192.168.202.53@tcp:39:umount.0 Request processed in 272us (504us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788658513.326582:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 258 00010000:00010000:3.0:1788658513.326588:0:6524:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a1d82762000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788658513.326646:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658513.326650:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788658513.326658:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97800/0x48e67cc629c6f60d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc9ef expref: 20 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.326677:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e7ef00) 00010000:00010000:3.0:1788658513.326679:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658513.326683:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96a00/0x48e67cc629c6f304 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc90f expref: 19 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.326694:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658513.326696:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788658513.326700:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97400/0x48e67cc629c6f955 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccacf expref: 18 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.326753:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658513.326756:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788658513.326760:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030c00/0x48e67cc629c6ec43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc733 expref: 17 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.326774:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658513.326777:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788658513.326781:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80030400/0x48e67cc629c6f286 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8ec expref: 16 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.326791:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8a1e88496600) 00010000:00010000:3.0:1788658513.326794:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788658513.326797:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031e00/0x48e67cc629c6ef3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc80c expref: 15 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.327163:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83403a00) 00010000:00010000:3.0:1788658513.327166:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658513.327171:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0000/0x48e67cc629c6ebe8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc71e expref: 14 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.327186:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658513.327194:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658513.327198:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e80031200/0x48e67cc629c6f25c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8de expref: 13 pid: 7958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.327211:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658513.327213:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658513.327216:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1000/0x48e67cc629c6f84b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcca89 expref: 12 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.327230:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1e90e70000) 00010000:00010000:3.0:1788658513.327232:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658513.327235:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c6ebcc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc717 expref: 11 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.328039:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8a1e90e7e500) 00010000:00010000:3.0:1788658513.328041:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788658513.328048:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97a00/0x48e67cc629c6f320 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc916 expref: 10 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.328063:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8a1e90e7ee00) 00010000:00010000:3.0:1788658513.328065:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658513.328077:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0400/0x48e67cc629c6f92b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccac1 expref: 9 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.328092:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8a1e90e7e400) 00010000:00010000:3.0:1788658513.328094:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658513.328098:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a0c00/0x48e67cc629c6f17c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc8a6 expref: 8 pid: 11974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658513.328112:0:6524:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a1d82762000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788658513.328891:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658513.328894:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658513.328897:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658513.353820:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658513.354485:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658513.354574:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001071616 00000100:00100000:3.0:1788658513.354585:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001071616 00000100:00100000:3.0:1788658513.354667:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 259 00000100:00100000:3.0:1788658513.354678:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+5:2395:x1875544001071616:12345-192.168.202.53@tcp:39:umount.0 00000020:00000080:3.0:1788658513.354742:0:6536:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e8a7 00000100:00080000:3.0:1788658513.354759:0:6536:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7417800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788658513.354790:0:6536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788658513.354950:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cbe5c26-08aa-4214-8c09-2005fb4b10e9+3:2395:x1875544001071616:12345-192.168.202.53@tcp:39:umount.0 Request processed in 274us (470us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788658513.354958:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 259 00010000:00010000:2.0:1788658513.355245:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658513.356040:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658514.108645:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658514.108695:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658514.108781:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658514.108914:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001071872 00000100:00100000:0.0:1788658514.108924:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001071872 00000100:00100000:0.0:1788658514.108994:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001072000 00000100:00100000:0.0:1788658514.108999:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001072000 00000100:00100000:0.0:1788658514.109024:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 384 00000100:00100000:0.0:1788658514.109034:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2398:x1875544001071872:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658514.109131:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2398:x1875544001071872:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 98us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658514.109138:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 384 00000100:00100000:0.0:1788658514.109172:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 385 00000100:00100000:0.0:1788658514.109178:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001072000:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658514.109205:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2398:x1875544001072000:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658514.109211:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 385 00000100:00080000:1.0:1788658514.109287:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658514.109291:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658514.109736:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001071744 00000100:00100000:2.0:1788658514.109750:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001071744 00000100:00100000:2.0:1788658514.109794:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 400 00000100:00100000:2.0:1788658514.109801:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:2398:x1875544001071744:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658514.109843:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:552b02cf-e822-4974-bfd4-4217116bc45f+10:2398:x1875544001071744:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 43us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658514.109850:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 400 00010000:00010000:3.0:1788658514.367409:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658515.390978:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658515.391810:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658515.391834:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025237632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658515.391912:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658515.391968:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025237632 00000100:00100000:3.0:1788658515.391985:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025237632 00000100:00100000:3.0:1788658515.392043:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788658515.392053:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025237632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658515.392087:0:6541:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788658515.392392:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025237632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 340us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658515.392402:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788658515.397999:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025237632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658515.697048:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658515.697095:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658515.697133:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658515.697165:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001072128 00000100:00100000:3.0:1788658515.697173:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001072128 00000100:00100000:2.0:1788658515.697464:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001072384 00000100:00100000:2.0:1788658515.697469:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001072384 00000100:00100000:2.0:1788658515.697523:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001072256 00000100:00100000:2.0:1788658515.697526:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001072256 00000100:00100000:2.0:1788658515.697548:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1788658515.697558:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:552b02cf-e822-4974-bfd4-4217116bc45f+12:2397:x1875544001072384:12345-192.168.202.53@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788658515.697558:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:0.0:1788658515.697567:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+12:2397:x1875544001072256:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658515.697577:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658515.697584:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658515.697596:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d834a0800/0x48e67cc629c6eb63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc702 expref: 12 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658515.697603:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6e9aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc676 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658515.697615:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658515.697615:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658515.697670:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:552b02cf-e822-4974-bfd4-4217116bc45f+10:2397:x1875544001072384:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 109us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658515.697678:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:3.0:1788658515.697793:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:3.0:1788658515.697801:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:552b02cf-e822-4974-bfd4-4217116bc45f+9:2397:x1875544001072128:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658515.697809:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658515.697819:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390600/0x48e67cc629c6e9a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc645 expref: 9 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658515.697828:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658515.697997:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae3bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:552b02cf-e822-4974-bfd4-4217116bc45f+8:2397:x1875544001072256:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 430us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658515.698005:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1788658515.713460:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:552b02cf-e822-4974-bfd4-4217116bc45f+7:2397:x1875544001072128:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 15646us (16407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658515.713475:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:3.0:1788658515.736330:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658515.736513:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001072640 00000100:00100000:1.0:1788658515.736546:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001072640 00000100:00100000:1.0:1788658515.736621:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 260 00000100:00100000:1.0:1788658515.736632:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+6:2395:x1875544001072640:12345-192.168.202.53@tcp:39:umount.0 00000020:00000080:1.0:1788658515.736678:0:6536:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e9b8 00000020:00010000:1.0:1788658515.736689:0:6536:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a1eb744c800: total 0 00000100:00080000:1.0:1788658515.736694:0:6536:0:(import.c:65:import_set_state_nolock()) ffff8a1eb744e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658515.736767:0:6536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788658515.736938:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2395:x1875544001072640:12345-192.168.202.53@tcp:39:umount.0 Request processed in 305us (615us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788658515.736947:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 260 00000020:00010000:2.0:1788658515.737123:0:7486:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a1eb744c800: total 0 00010000:00010000:2.0:1788658515.737128:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658515.737201:0:7486:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a1eb744c800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788658515.737239:0:7486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1e90e7ef00) 00010000:00010000:2.0:1788658515.737253:0:7486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658515.737263:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d834a1a00/0x48e67cc629c6f978 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccadd expref: 4 pid: 6536 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658515.737299:0:7486:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a1eb744c800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788658515.737313:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658515.737314:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658515.737316:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658515.749089:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658515.749361:0:11974:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001072768 00000100:00100000:2.0:1788658515.749371:0:11974:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001072768 00000100:00100000:2.0:1788658515.749434:0:11974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 261 00000100:00100000:2.0:1788658515.749444:0:11974:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+5:2395:x1875544001072768:12345-192.168.202.53@tcp:39:umount.0 00000020:00000080:2.0:1788658515.749487:0:11974:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e9bf 00000100:00080000:2.0:1788658515.749498:0:11974:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7449800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658515.749541:0:11974:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788658515.749764:0:11974:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bab2558f-23d6-4f42-bb42-9568fb514d36+3:2395:x1875544001072768:12345-192.168.202.53@tcp:39:umount.0 Request processed in 320us (683us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788658515.749772:0:11974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 261 00010000:00010000:3.0:1788658515.751305:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658515.783843:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658515.783953:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001073024 00000100:00100000:2.0:1788658515.783963:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001073024 00000100:00100000:2.0:1788658515.784022:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 401 00000100:00100000:2.0:1788658515.784033:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+7:2395:x1875544001073024:12345-192.168.202.53@tcp:251:umount.0 00000020:00000080:2.0:1788658515.784077:0:6530:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e87d 00000020:00010000:2.0:1788658515.784084:0:6530:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a1d81abc000: total 0 00000100:00080000:2.0:1788658515.784100:0:6530:0:(import.c:65:import_set_state_nolock()) ffff8a1d81abf000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788658515.784173:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1275450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:552b02cf-e822-4974-bfd4-4217116bc45f+3:2395:x1875544001073024:12345-192.168.202.53@tcp:251:umount.0 Request processed in 142us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658515.784180:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 401 00000020:00010000:0.0:1788658515.784407:0:6525:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a1d81abc000: total 0 00010000:00010000:0.0:1788658515.784467:0:6525:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a1d81abc000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788658515.784517:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391e00/0x48e67cc629c6e8d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bcc637 expref: 2 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658515.784552:0:6525:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a1d81abc000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788658515.784565:0:6525:0:(genops.c:885:class_export_put()) final put ffff8a1d81abc000/552b02cf-e822-4974-bfd4-4217116bc45f 00010000:00010000:0.0:1788658515.784585:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658515.784587:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658515.784589:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788658515.785056:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d81abc000/552b02cf-e822-4974-bfd4-4217116bc45f for MGS 00000020:00000080:2.0:1788658515.785100:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d81abf000 for MGS 00010000:00010000:1.0:1788658516.421779:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658516.927251:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025237760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658516.927351:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658516.927572:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025237760 00000100:00100000:0.0:1788658516.927585:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025237760 00000100:00100000:0.0:1788658516.927664:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788658516.927677:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025237760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658516.927742:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788658516.927798:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025237760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658516.927818:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1788658516.928123:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658516.928174:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025237760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658516.928453:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025238016:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.928496:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658516.928524:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025238528:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.928551:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658516.928576:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025239040:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.928597:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658516.928621:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788658516.928627:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025237888:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.928659:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658516.928680:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025238400:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.928726:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658516.928764:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025238912:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.929082:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658516.929135:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658516.929146:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025239424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658516.929173:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658516.929206:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025238016 00000100:00100000:0.0:1788658516.929227:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025238016 00000100:00100000:0.0:1788658516.929271:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025238528 00000100:00100000:0.0:1788658516.929275:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025238528 00000100:00100000:0.0:1788658516.929300:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025239040 00000100:00100000:0.0:1788658516.929304:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025239040 00000100:00100000:0.0:1788658516.929321:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788658516.929329:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025238016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.929378:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025238016:12345-0@lo:400:kworker.0 Request processed in 50us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658516.929386:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788658516.929403:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788658516.929409:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025238528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.929434:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025238528:12345-0@lo:400:kworker.0 Request processed in 26us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658516.929439:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788658516.929450:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788658516.929456:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025239040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.929483:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025239040:12345-0@lo:400:kworker.0 Request processed in 27us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658516.929489:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788658516.929528:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025238016:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.929550:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025238528:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.929560:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025239040:0@lo:400:kworker.0 00000100:00100000:1.0:1788658516.929748:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025238400 00000100:00100000:1.0:1788658516.929753:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025238400 00000100:00100000:1.0:1788658516.929802:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788658516.929811:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025238400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658516.929865:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025238400:12345-0@lo:400:kworker.0 Request processed in 56us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658516.929871:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788658516.929892:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025239424 00000100:00100000:1.0:1788658516.929895:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025239424 00000100:00100000:1.0:1788658516.929924:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788658516.929944:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025239424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658516.929961:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788658516.930001:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025239424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658516.930007:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788658516.930029:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025238144:0@lo:400:kworker.0 00000100:00100000:1.0:1788658516.930059:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658516.930082:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025238656:0@lo:400:kworker.0 00000100:00100000:1.0:1788658516.930106:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658516.930126:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025239168:0@lo:400:kworker.0 00000100:00100000:1.0:1788658516.930149:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658516.930169:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788658516.930175:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025238272:0@lo:400:kworker.0 00000100:00100000:1.0:1788658516.930195:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658516.930224:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025238784:0@lo:400:kworker.0 00000100:00100000:1.0:1788658516.930248:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658516.930370:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025238144 00000100:00100000:0.0:1788658516.930375:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025238144 00000100:00100000:0.0:1788658516.930402:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788658516.930410:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025238144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.930447:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025238144:12345-0@lo:400:kworker.0 Request processed in 38us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658516.930453:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788658516.930761:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025238656 00000100:00100000:3.0:1788658516.930766:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025238656 00000100:00100000:3.0:1788658516.930804:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025239168 00000100:00100000:3.0:1788658516.930807:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025239168 00000100:00100000:3.0:1788658516.930834:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025238272 00000100:00100000:3.0:1788658516.930838:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025238272 00000100:00100000:3.0:1788658516.930853:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788658516.930860:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025238656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658516.930914:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025238656:12345-0@lo:400:kworker.0 Request processed in 55us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658516.930921:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788658516.930950:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788658516.930956:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025239168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658516.930983:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025239168:12345-0@lo:400:kworker.0 Request processed in 28us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658516.930989:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788658516.931000:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788658516.931006:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025238272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658516.931031:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025238272:12345-0@lo:400:kworker.0 Request processed in 25us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658516.931037:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788658516.931060:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025237888 00000100:00100000:3.0:1788658516.931064:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025237888 00000100:00100000:3.0:1788658516.931104:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1788658516.931111:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025237888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658516.931144:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ec1277850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025237888:12345-0@lo:400:kworker.0 Request processed in 34us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658516.931151:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00080000:0.0:1788658516.931570:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658516.931576:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658516.931578:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658516.931641:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025239424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658516.931656:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025237888:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.931670:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025238400:0@lo:400:kworker.0 00000100:00100000:1.0:1788658516.932109:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025239296:0@lo:400:kworker.0 00000100:00100000:1.0:1788658516.932157:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658516.932346:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025238144:0@lo:400:kworker.0 00010000:00080000:1.0:1788658516.932363:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb7403100 x1875544025238656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658516.932374:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025238656:0@lo:400:kworker.0 00010000:00080000:1.0:1788658516.932387:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb7400e00 x1875544025239168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658516.932395:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025239168:0@lo:400:kworker.0 00000100:00100000:1.0:1788658516.932420:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025238272:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.936436:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025238912 00000100:00100000:0.0:1788658516.936464:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025238912 00000100:00100000:0.0:1788658516.936549:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025238784 00000100:00100000:0.0:1788658516.936554:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025238784 00000100:00100000:0.0:1788658516.936582:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025239296 00000100:00100000:0.0:1788658516.936586:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025239296 00000100:00100000:0.0:1788658516.936610:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788658516.936621:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025238912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.936757:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83757800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025238912:12345-0@lo:400:kworker.0 Request processed in 138us (7965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658516.936793:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788658516.936980:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788658516.936991:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025238784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.937038:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025238784:12345-0@lo:400:kworker.0 Request processed in 50us (6788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658516.937044:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788658516.937059:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788658516.937066:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025239296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.937097:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025239296:12345-0@lo:400:kworker.0 Request processed in 33us (4941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658516.937103:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788658516.937167:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025238784:0@lo:400:kworker.0 00000100:00100000:0.0:1788658516.937182:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025239296:0@lo:400:kworker.0 00000100:00080000:0.0:1788658516.937293:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658516.937322:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025238912:0@lo:400:kworker.0 00000100:00100000:1.0:1788658517.438977:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025239552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658517.439085:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658517.439185:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025239552 00000100:00100000:1.0:1788658517.439198:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025239552 00000100:00100000:1.0:1788658517.439252:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788658517.439276:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025239552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658517.439314:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658517.439379:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025239552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658517.439388:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788658517.439449:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025239552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658517.441498:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658517.441589:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025239680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658517.441790:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658517.441848:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025239680 00000100:00100000:0.0:1788658517.441858:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025239680 00000100:00100000:0.0:1788658517.441999:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788658517.442010:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025239680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658517.442038:0:8455:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788658517.442092:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025239680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658517.442112:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788658517.442177:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025239680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788658517.442783:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658517.764152:0:13816:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788658517.826616:0:15171:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788658517.856945:0:15171:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788658517.857034:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.857053:0:15171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.857063:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.857071:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.857106:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788658517.857113:0:15171:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788658517.857146:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658517.857152:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788658517.857161:0:15171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788658517.857199:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8a1e840ed000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788658517.857243:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025239808:0@lo:39:umount.0 00000100:00100000:2.0:1788658517.857337:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658517.857544:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658517.857553:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658517.857561:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658517.857565:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658517.857587:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658517.857595:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658517.857600:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658517.857603:0:6525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788658517.857606:0:6525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788658517.857638:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658517.857645:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658517.857673:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658517.857680:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3800/0x48e67cc629c6e933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e93a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658517.857694:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658517.857696:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658517.857698:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658517.857743:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025239808 00000100:00100000:3.0:1788658517.857751:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025239808 00000100:00100000:3.0:1788658517.857808:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788658517.857828:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875544025239808:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788658517.857862:0:6538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e494 00000100:00080000:3.0:1788658517.857872:0:6538:0:(import.c:65:import_set_state_nolock()) ffff8a1eabc1d800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788658517.857959:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1875544025239808:12345-0@lo:39:umount.0 Request processed in 141us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658517.857973:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788658517.857985:0:6538:0:(genops.c:885:class_export_put()) final put ffff8a1ec1291000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1788658517.858013:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658517.858035:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025239936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658517.858068:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658517.858111:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025239936 00000100:00100000:3.0:1788658517.858115:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025239936 00000100:00100000:3.0:1788658517.858154:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658517.858162:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3647:x1875544025239936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658517.858174:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658517.858192:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391600/0x48e67cc629c6e93a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e933 expref: 24 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658517.858209:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658517.858237:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:3647:x1875544025239936:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658517.858243:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658517.858282:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025239936:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788658517.858315:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e840ed000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788658517.858324:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025239808:0@lo:39:umount.0 00000100:00080000:2.0:1788658517.858598:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658517.858602:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788658517.858608:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658517.859221:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1291000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788658517.859294:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eabc1d800 for lustre-MDT0000 00010000:00010000:0.0:1788658517.859324:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658517.866794:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.866963:0:15171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.866972:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.866980:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.867067:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658517.867076:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.867084:0:15171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.867091:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.867097:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.885058:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658517.885075:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.885086:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658517.885090:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.885100:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658517.885106:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658517.885111:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658517.885113:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788658517.885208:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.885213:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658517.885245:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.885252:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3000/0x48e67cc629c6e941 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e948 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658517.885283:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025240064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658517.885304:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658517.885308:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.885323:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658517.885327:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.885335:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658517.885341:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658517.885346:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658517.885348:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1788658517.885361:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.885367:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658517.885377:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658517.885379:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658517.885391:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025240192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658517.885420:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658517.885446:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658517.885448:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658517.885450:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658517.885457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025240064 00000100:00100000:1.0:1788658517.885467:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025240064 00000100:00100000:3.0:1788658517.885506:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025240192 00000100:00100000:3.0:1788658517.885512:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025240192 00000100:00100000:3.0:1788658517.885572:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658517.885585:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3650:x1875544025240192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658517.885601:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788658517.885618:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658517.885634:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+24:3649:x1875544025240064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658517.885643:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658517.885658:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b2200/0x48e67cc629c6e948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e941 expref: 24 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.885673:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658517.885734:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:3649:x1875544025240064:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658517.885742:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658517.885935:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3649:1875544025240064:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658517.885952:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658517.885963:0:15171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97000/0x48e67cc629c6e837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e83e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658517.885978:0:15171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788658517.885990:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.886006:0:15171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.886014:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.886034:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.886054:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658517.886061:0:15171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.886061:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658517.886069:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.886072:0:15171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.886089:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d0200 already unused, calling callback (ffffffffc116ac20) 00010000:00010000:2.0:1788658517.886090:0:15171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658517.886096:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.886100:0:15171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.886110:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658517.886115:0:15171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788658517.886123:0:15171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:00010000:0.0:1788658517.886124:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658517.886127:0:15171:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:0.0:1788658517.886134:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788658517.886137:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788658517.886139:0:7486:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788658517.886159:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.886166:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:2.0:1788658517.886170:0:15171:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788658517.886177:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788658517.886183:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658517.886189:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00010000:00010000:0.0:1788658517.886197:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788658517.886202:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1d82765800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:1.0:1788658517.886212:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025240320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658517.886212:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d0200/0x48e67cc629c6eb9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6eba2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788658517.886216:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1ebd9a8800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788658517.886229:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1eb3231000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788658517.886233:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:2.0:1788658517.886235:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8a1e840ed800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00010000:00010000:0.0:1788658517.886239:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788658517.886247:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8a1eb744c800 bab2558f-23d6-4f42-bb42-9568fb514d36 192.168.202.53@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:1.0:1788658517.886248:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658517.886249:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670800 already unused, calling callback (ffffffffc116ac20) 00000020:00080000:2.0:1788658517.886256:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8a1d82762000 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 192.168.202.53@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1788658517.886262:0:15171:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8a1e844519c0) has exports, disconnecting them 00000020:00080000:2.0:1788658517.886268:0:15171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1d82765800), last request at 1788658516 00000020:00000080:2.0:1788658517.886275:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e7a4 00000100:00100000:1.0:1788658517.886294:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025240320 00000100:00080000:2.0:1788658517.886297:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8a1d82763800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788658517.886300:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025240320 00000100:00100000:1.0:1788658517.886338:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658517.886346:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+23:3647:x1875544025240320:12345-0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788658517.886348:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d82765800): rc 0 00000020:00000080:2.0:1788658517.886353:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1d82765800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1788658517.886360:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:2.0:1788658517.886367:0:15171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1ebd9a8800), last request at 1788658516 00000020:00000080:2.0:1788658517.886371:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e67e 00010000:00010000:1.0:1788658517.886374:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e80030a00/0x48e67cc629c6eba2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6eb9b expref: 23 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788658517.886378:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8a1ebd9af800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788658517.886388:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1ebd9a8800): rc 0 00000020:00000080:2.0:1788658517.886390:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1ebd9a8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788658517.886396:0:15171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1eb3231000), last request at 1788658272 00000020:00000080:2.0:1788658517.886401:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e57b 00000100:00080000:2.0:1788658517.886406:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3234000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788658517.886408:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1788658517.886412:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1eb3231000): rc 0 00000020:00000080:2.0:1788658517.886414:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1eb3231000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788658517.886418:0:15171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a1e840ed800), last request at 1788658272 00000020:00000080:2.0:1788658517.886422:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e53c 00000100:00080000:2.0:1788658517.886425:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3230000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658517.886433:0:15171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:1.0:1788658517.886444:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a017dcfd-fba9-49c7-bb83-f753e9511c6f+22:3647:x1875544025240320:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658517.886452:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658517.886482:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3647:1875544025240320:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788658517.886535:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1e840ed800): rc 0 00000004:00000080:2.0:1788658517.886542:0:15171:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa33e4808bae0 00000100:00080000:2.0:1788658517.886564:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788658517.886567:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:3.0:1788658517.886819:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b97e00/0x48e67cc629c6e83e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e837 expref: 21 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658517.886830:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658517.886901:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:3650:x1875544025240192:12345-0@lo:103:ldlm_bl.0 Request processed in 1318us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658517.886909:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788658517.886917:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025240192:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788658517.886938:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d82765800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788658517.886987:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebd9a8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788658517.887012:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb3231000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788658517.887131:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d82763800 for lustre-MDT0000 00000020:00000080:3.0:1788658517.887137:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ebd9af800 for lustre-MDT0000 00000020:00000080:3.0:1788658517.887141:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb3234000 for lustre-MDT0000 00010000:00010000:3.0:1788658517.887153:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1788658517.887382:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.887390:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658517.887395:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658517.887399:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658517.887401:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788658517.887403:0:7486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788658517.887423:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.887427:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658517.887440:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.887447:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e81670800/0x48e67cc629c6e3f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e3fa expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658517.887473:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658517.887475:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658517.887477:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658517.887490:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025240448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658517.887526:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658517.887559:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025240448 00000100:00100000:1.0:1788658517.887565:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025240448 00000100:00100000:1.0:1788658517.887613:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788658517.887623:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+20:3648:x1875544025240448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658517.887634:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658517.887644:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec2045c00/0x48e67cc629c6e3fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e3f3 expref: 20 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658517.887655:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658517.887748:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83756a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025240448:0@lo:103:ldlm_bl.0 00000040:00080000:3.0:1788658517.887881:0:13813:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788658517.887886:0:13813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788658517.887955:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a017dcfd-fba9-49c7-bb83-f753e9511c6f+19:3648:x1875544025240448:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658517.887964:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000040:00080000:3.0:1788658517.887965:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788658517.887973:0:13813:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788658517.890071:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788658517.891480:0:15171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788658517.892271:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8a1ebd9a8000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788658517.892504:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025240576:0@lo:39:umount.0 00000100:00100000:0.0:1788658517.892601:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788658517.892605:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788658517.892611:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788658517.892799:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788658517.892876:0:15171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788658517.892899:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8a1d8230a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788658517.892909:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788658517.892912:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788658517.892924:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788658517.893008:0:15171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788658517.893019:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7448800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788658517.893054:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a1e844519c0) has no exports 00000100:00100000:0.0:1788658517.893379:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025240704:0@lo:9:umount.0 00000100:00100000:0.0:1788658517.893419:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658517.893448:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025240832:0@lo:9:umount.0 00000100:00100000:0.0:1788658517.893470:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658517.894598:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025240704 00000100:00100000:2.0:1788658517.894612:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025240704 00000100:00100000:2.0:1788658517.894686:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025240832 00000100:00100000:2.0:1788658517.894690:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025240832 00000100:00100000:2.0:1788658517.894747:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788658517.894759:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875544025240704:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788658517.894794:0:10365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e726 00000100:00080000:2.0:1788658517.894806:0:10365:0:(import.c:65:import_set_state_nolock()) ffff8a1d8230f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658517.894975:0:10365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788658517.895243:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3646:x1875544025240704:12345-0@lo:9:umount.0 Request processed in 485us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658517.895253:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788658517.895294:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788658517.895301:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875544025240832:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788658517.895316:0:10365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e868 00000100:00080000:2.0:1788658517.895322:0:10365:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7412800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658517.895346:0:10365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788658517.895426:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3646:x1875544025240832:12345-0@lo:9:umount.0 Request processed in 125us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658517.895432:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1788658517.895773:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658517.895902:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d8230a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788658517.895917:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788658517.895920:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658517.895925:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025240704:0@lo:9:umount.0 00000100:00080000:0.0:1788658517.895940:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7448800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788658517.895951:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788658517.895952:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658517.895954:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025240832:0@lo:9:umount.0 00010000:00010000:0.0:1788658517.896785:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658517.897269:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025240576 00000100:00100000:3.0:1788658517.897281:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025240576 00000100:00100000:3.0:1788658517.897417:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788658517.897428:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875544025240576:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788658517.897467:0:6542:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e5d6 00000100:00080000:3.0:1788658517.897477:0:6542:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1d93800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788658517.897511:0:6542:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1788658517.897580:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658517.897749:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3646:x1875544025240576:12345-0@lo:39:umount.0 Request processed in 322us (5147us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788658517.897757:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:2.0:1788658517.897867:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebd9a8000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788658517.897877:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025240576:0@lo:39:umount.0 00000020:00080000:2.0:1788658517.905978:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8a1e844519c0) has no exports 00000100:00100000:1.0:1788658517.951070:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658517.951106:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025240960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658517.951211:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658517.951306:0:7782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025240960 00000100:00100000:1.0:1788658517.951316:0:7782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025240960 00000100:00100000:1.0:1788658517.951373:0:7782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788658517.951382:0:7782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1875544025240960:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788658517.951413:0:7782:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788658517.951459:0:7782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1875544025240960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (250us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788658517.951467:0:7782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:02020000:1.0:1788658517.951514:0:3650:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1788658517.963951:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788658517.963963:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3231800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788658517.963970:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788658517.971419:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3231800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658517.971435:0:3650:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 189 00000100:00080000:1.0:1788658517.971446:0:3650:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a1eb3231800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658517.971612:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83754e00 x1875544025241088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658517.971787:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025241088:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788658517.971993:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658517.972162:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025241088 00000100:00100000:0.0:1788658517.972172:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025241088 00000100:00100000:0.0:1788658517.972244:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788658517.972253:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025241088:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788658517.972275:0:6542:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788658517.977433:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025241088:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 5164us (5424us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788658517.977453:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:3.0:1788658517.980041:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3231800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658517.980056:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788658517.980062:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025241088:0@lo:38:ptlrpcd_00_03.0 00000020:00000080:2.0:1788658517.985450:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e44e 00000020:00000080:2.0:1788658517.985467:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1eb2120000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788658517.985491:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788658517.985540:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb2120000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788658517.985884:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658517.985899:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788658517.985905:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8a1e84450000) has no exports 00000020:00000080:3.0:1788658517.986322:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e447 00000020:00000080:3.0:1788658517.986331:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1eb2125000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788658517.986390:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658517.986399:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788658517.986402:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1eb2123000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788658517.986405:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb2123000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788658517.986410:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788658517.986597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb2125000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788658518.462981:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788658518.978799:0:7466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788658518.978881:0:7466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788658518.978890:0:7466:0:(genops.c:885:class_export_put()) final put ffff8a1ebd8b2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788658518.978918:0:7466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bab2558f-23d6-4f42-bb42-9568fb514d36 00000001:00080000:2.0:1788658518.978925:0:7466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788658518.978928:0:7466:0:(genops.c:885:class_export_put()) final put ffff8a1eb744d000/bab2558f-23d6-4f42-bb42-9568fb514d36 00000001:00100000:2.0:1788658518.978935:0:7466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000001:00080000:2.0:1788658518.978939:0:7466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788658518.978941:0:7466:0:(genops.c:885:class_export_put()) final put ffff8a1eb7414800/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000001:00100000:2.0:1788658518.981020:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788658518.981034:0:9530:0:(genops.c:885:class_export_put()) final put ffff8a1eb7411000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788658518.981057:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:2.0:1788658518.981060:0:9530:0:(genops.c:885:class_export_put()) final put ffff8a1e98865000/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:0.0:1788658518.981278:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebd8b2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788658518.981365:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb744d000/bab2558f-23d6-4f42-bb42-9568fb514d36 for lustre-MDT0001 00000020:00000080:0.0:1788658518.981399:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb7414800/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 for lustre-MDT0001 00000020:00000080:0.0:1788658518.981423:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb7411000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788658518.981442:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e98865000/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 for lustre-OST0001 00000020:00000080:0.0:1788658518.981471:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ec1d93800 for lustre-MDT0001 00000020:00000080:0.0:1788658518.981477:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb7449800 for lustre-MDT0001 00000020:00000080:0.0:1788658518.981481:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb7417800 for lustre-MDT0001 00000020:00000080:0.0:1788658518.981484:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb7412800 for lustre-OST0001 00000020:00000080:0.0:1788658518.981487:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1e98865800 for lustre-OST0001 00000001:00100000:1.0:1788658518.983321:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658518.983333:0:8447:0:(genops.c:885:class_export_put()) final put ffff8a1d82309800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788658518.983496:0:6515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788658518.983501:0:6515:0:(genops.c:885:class_export_put()) final put ffff8a1e840ed800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788658518.983549:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:1.0:1788658518.983553:0:8447:0:(genops.c:885:class_export_put()) final put ffff8a1d83705800/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:0.0:1788658518.994230:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d82309800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788658518.994332:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d8230f800 for lustre-OST0000 00000020:00000080:0.0:1788658518.994401:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e840ed800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000001:00100000:2.0:1788658518.994416:0:6515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bab2558f-23d6-4f42-bb42-9568fb514d36 00000001:00080000:2.0:1788658518.994431:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788658518.994436:0:6515:0:(genops.c:885:class_export_put()) final put ffff8a1eb744c800/bab2558f-23d6-4f42-bb42-9568fb514d36 00000020:00000080:0.0:1788658518.994441:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb3230000 for lustre-MDT0000 00000001:00100000:2.0:1788658518.994443:0:6515:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:0.0:1788658518.994445:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb744c800/bab2558f-23d6-4f42-bb42-9568fb514d36 for lustre-MDT0000 00000001:00080000:2.0:1788658518.994453:0:6515:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1788658518.994462:0:6515:0:(genops.c:885:class_export_put()) final put ffff8a1d82762000/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 00000020:00000080:0.0:1788658518.994466:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb744e800 for lustre-MDT0000 00000020:00000080:0.0:1788658518.994495:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d82762000/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 for lustre-MDT0000 00000020:00000080:0.0:1788658518.995979:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d82764800 for lustre-MDT0000 00000020:00000080:0.0:1788658518.995992:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d83705800/8cbe5c26-08aa-4214-8c09-2005fb4b10e9 for lustre-OST0000 00000020:00000080:0.0:1788658518.996035:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d83703800 for lustre-OST0000 00010000:00010000:1.0:1788658519.489765:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788658519.999146:0:15171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1d820fee40 - data ffff8a1d81d35ca8/ffff8a1d834ba400 00000020:01000000:2.0:1788658519.999361:0:15171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1e8f1ac6c0 - data ffff8a1e98f99870/ffff8a1eabc34c00 00000001:00000004:2.0:1788658520.016337:0:15171:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1788658520.125422:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788658520.125435:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788658520.125469:0:15171:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8a1d83d54380 x1875544025240576/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788658527 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658520.125509:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788658520.131262:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788658520.131275:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788658520.133160:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658520.133171:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788658520.137214:0:8611:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788658520.137225:0:8611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1788658520.137243:0:8611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788658520.138258:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788658520.138266:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788658520.138291:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788658520.138294:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788658520.139304:0:9971:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788658520.139311:0:9971:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1788658520.139324:0:9971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788658520.146264:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e416 00000020:00000080:1.0:1788658520.146283:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e84449800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788658520.149039:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e84449800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788658520.156790:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e42b 00000020:00000080:1.0:1788658520.156813:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e8444b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788658520.156843:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788658520.156851:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658520.156863:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788658520.156868:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8a1eae394d40) has no exports 00000004:01000000:1.0:1788658520.157109:0:15171:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788658520.157121:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e861 00000020:00000080:1.0:1788658520.157127:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1d81abc800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788658520.157131:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788658520.157135:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658520.157147:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788658520.157150:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8a1d8277b380) has no exports 00000020:00000080:1.0:1788658520.157159:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e85a 00000020:00000080:1.0:1788658520.157163:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1eb744f000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788658520.157575:0:15171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788658520.157582:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788658520.157588:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788658520.157596:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788658520.157600:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658520.157653:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658520.157663:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788658520.157672:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e71f 00000020:00000080:1.0:1788658520.157678:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1eb3235800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788658520.157682:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788658520.157686:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658520.157690:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788658520.157693:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8a1d821b8000) has no exports 00000020:00000080:1.0:1788658520.157697:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e718 00000020:00000080:1.0:1788658520.157700:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1d8230f000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788658520.158115:0:15171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788658520.158119:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788658520.158122:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788658520.158127:0:15171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788658520.158128:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658520.158161:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658520.158167:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788658520.158180:0:15171:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788658520.158196:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e5cf 00000020:00000080:1.0:1788658520.158203:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1ebdaea000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788658520.158208:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788658520.158211:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658520.158215:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788658520.158217:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8a1eb2243380) has no exports 00000020:00000080:1.0:1788658520.158222:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e5c8 00000020:00000080:1.0:1788658520.158225:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1ebd9ab000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788658520.160134:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e8444b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788658520.160158:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d81abc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788658520.160164:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb744f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788658520.160174:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb7448800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788658520.160186:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1d81abd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788658520.160189:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d81abd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788658520.160195:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788658520.160309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb3235800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788658520.160316:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d8230f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788658520.160321:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d8230a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788658520.160326:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1d8230b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788658520.160328:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d8230b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788658520.160332:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788658520.160385:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdaea000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788658520.160391:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebd9ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788658520.160428:0:15171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788658520.160433:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788658520.160450:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788658520.160459:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658520.160487:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ebd9a8000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788658520.160534:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658520.160548:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788658520.160552:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1ebd9ae800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788658520.160554:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebd9ae800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788658520.160558:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788658520.160628:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658520.160632:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788658520.160635:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e8444c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788658520.160637:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e8444c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788658520.160641:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788658520.160736:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e432 00000020:00000080:0.0:1788658520.160745:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e8444d800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788658520.160753:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788658520.160762:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e8444d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788658520.160771:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658520.160777:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788658520.160782:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8a1e84454d40) has no exports 00000020:00000080:0.0:1788658520.160802:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658520.160805:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788658520.160807:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e8444f000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788658520.160809:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e8444f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788658520.160813:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788658520.160865:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e439 00000020:00000080:0.0:1788658520.160870:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e84448000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788658520.160885:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e84448000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788658520.161019:0:15171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1ec1212800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788658520.161025:0:15171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1ec1212800 3 00000020:01000004:0.0:1788658520.161029:0:15171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1ec1212800 from lustre-MDT0000 00000020:00000080:0.0:1788658520.161054:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658520.161058:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788658520.161061:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e8444c800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788658520.161063:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e8444c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788658520.161071:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788658520.161103:0:15171:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788658520.161109:0:15171:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788658520.161112:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788658520.161115:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658520.161118:0:15171:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788658520.161128:0:15171:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8a1e9033b800 a017dcfd-fba9-49c7-bb83-f753e9511c6f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658520.161134:0:15171:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8a1e8f253380) has exports, disconnecting them 00000020:00080000:0.0:1788658520.161141:0:15171:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a1e9033b800), last request at 1788658252 00000020:00000080:0.0:1788658520.161160:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e3d7 00000020:00010000:0.0:1788658520.161166:0:15171:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8a1e9033b800: total 0 00000100:00080000:0.0:1788658520.161171:0:15171:0:(import.c:65:import_set_state_nolock()) ffff8a1e9033a800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788658520.161195:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1e9033b800): rc 0 00000020:00080000:0.0:1788658520.161200:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8a1e8f253380) has no exports 00000100:00100000:0.0:1788658520.161267:0:6530:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a1e8f244200:6530] 1 exiting: rc = 0 00000100:00100000:0.0:1788658520.161403:0:6531:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a1e8f245600:6531] 2 exiting: rc = 0 00000100:00100000:3.0:1788658520.161565:0:6529:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a1e8f245a00:6529] 0 exiting: rc = 1 00000020:00010000:3.0:1788658520.161639:0:6524:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8a1e9033b800: total 0 00010000:00010000:3.0:1788658520.161680:0:6524:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a1e9033b800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788658520.161734:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390c00/0x48e67cc629c6e8e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e8df expref: 14 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161750:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d1c00/0x48e67cc629c6eb94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6eb8d expref: 13 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161780:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390000/0x48e67cc629c6e7f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e7f1 expref: 12 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161795:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83419000/0x48e67cc629c6eb86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6eb7f expref: 11 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161806:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b2400/0x48e67cc629c6e956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e94f expref: 10 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161817:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391200/0x48e67cc629c6e8f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e8ed expref: 9 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161842:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96000/0x48e67cc629c6e902 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e8fb expref: 8 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161853:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d0a00/0x48e67cc629c6e910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e909 expref: 7 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161863:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b3a00/0x48e67cc629c6e91e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e917 expref: 6 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161874:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec21d0000/0x48e67cc629c6e4d3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e4cc expref: 5 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161887:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81671e00/0x48e67cc629c6e4e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e4da expref: 4 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161911:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d834a1c00/0x48e67cc629c6eb78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6eb71 expref: 3 pid: 6531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161939:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb23b2a00/0x48e67cc629c6e92c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x48e67cc629c6e925 expref: 2 pid: 6529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658520.161949:0:6524:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a1e9033b800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788658520.161963:0:6524:0:(genops.c:885:class_export_put()) final put ffff8a1e9033b800/a017dcfd-fba9-49c7-bb83-f753e9511c6f 00010000:00010000:3.0:1788658520.161977:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658520.161980:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658520.161981:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788658520.161990:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e9033b800/a017dcfd-fba9-49c7-bb83-f753e9511c6f for MGS 00000020:00000080:3.0:1788658520.162019:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1e9033a800 for MGS 00000100:00100000:0.0:1788658520.164314:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164327:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164333:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164340:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164347:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164374:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164381:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164387:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164393:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164401:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164408:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164416:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164422:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164428:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164435:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164452:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164459:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164466:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164473:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164479:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164485:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164492:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164499:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164505:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164513:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164519:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164524:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164530:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164536:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164542:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164548:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164553:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164560:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164566:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164572:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164578:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164583:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164588:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164594:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164600:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164614:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164620:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164626:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164633:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164639:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164645:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164650:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164657:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164664:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164669:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164675:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164681:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164687:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164692:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164697:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164736:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164744:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164749:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164754:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164759:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164765:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164770:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164776:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658520.164782:0:15171:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788658520.171663:0:15171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1d83312ba0 - data ffff8a1d81c4eca8/ffff8a1d83442400 00000020:01000000:0.0:1788658520.171883:0:15171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1e83b08a80 - data ffff8a1e9ec436c0/ffff8a1e98999000 00000020:00000080:0.0:1788658520.172631:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e3bb 00000020:00000080:0.0:1788658520.172644:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e82c47800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788658520.172669:0:15171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1ec1212800 from MGS, refs=2 00000020:01000004:0.0:1788658520.172674:0:15171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1ec1212800 2 00000020:01000004:0.0:1788658520.172678:0:15171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1ec1212800 from MGS 00000020:00000080:3.0:1788658520.173026:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e82c47800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788658520.173118:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658520.173129:0:15171:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788658520.173134:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e82c42800/MGS 00000020:00000080:0.0:1788658520.173152:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e82c42800/MGS for MGS 00000020:01000000:0.0:1788658520.173160:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788658520.173248:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788658520.173253:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658520.173259:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788658520.173268:0:15171:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a1e840e9000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658520.173275:0:15171:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8a1eb2240000) has exports, disconnecting them 00000020:00080000:0.0:1788658520.173281:0:15171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a1e840e9000), last request at 1788658252 00000020:00000080:0.0:1788658520.173286:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e486 00000020:00080000:0.0:1788658520.173299:0:15171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1e840e9000): rc 0 00000020:00000080:0.0:1788658520.173305:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e840e9000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788658520.177599:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e840e9000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788658520.362096:0:15171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788658520.362110:0:15171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658520.362116:0:15171:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788658520.362141:0:15171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658520.362372:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658520.362383:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788658520.362393:0:15171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1ec1212800 1 00000020:00000080:1.0:1788658520.362401:0:15171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e3ad 00000020:00000080:1.0:1788658520.362413:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1e82c42000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788658520.362433:0:15171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788658520.362444:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658520.362448:0:15171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788658520.362453:0:15171:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8a1eae390000) has no exports 00000020:00000080:3.0:1788658520.362461:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1e840ed000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788658520.362471:0:8:0:(genops.c:885:class_export_put()) final put ffff8a1e840eb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788658520.362474:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e840eb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788658520.362487:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788658520.362591:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e82c42000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788658520.434925:0:15171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658520.434943:0:15171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788658520.434951:0:15171:0:(genops.c:885:class_export_put()) final put ffff8a1ec1217000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788658520.434958:0:15171:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1217000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788658520.434966:0:15171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788658520.435122:0:15171:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1ec1214800 00000020:02000400:1.0:1788658520.435200:0:15171:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788658520.515026:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658521.536363:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658522.049040:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658522.049046:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788658522.049050:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3231800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658522.049067:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 435 00000100:00080000:1.0:1788658522.049072:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788658522.049079:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a1eb3231800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658522.049099:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f3b80 x1875544025241344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658522.049169:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025241728:0@lo:400:kworker.0 00000100:00100000:1.0:1788658522.049230:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658522.049374:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025241472:0@lo:400:kworker.0 00000100:00100000:0.0:1788658522.049401:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658522.049441:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025241984:0@lo:400:kworker.0 00000100:00100000:0.0:1788658522.049460:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658522.049477:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788658522.049482:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025241600:0@lo:400:kworker.0 00000100:00100000:0.0:1788658522.049499:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658522.049513:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025242112:0@lo:400:kworker.0 00000100:00100000:0.0:1788658522.049528:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658522.049555:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025241728 00000100:00100000:0.0:1788658522.049573:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025241728 00000100:00100000:0.0:1788658522.049613:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025241472 00000100:00100000:0.0:1788658522.049616:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025241472 00000100:00100000:0.0:1788658522.049624:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025241984 00000100:00100000:0.0:1788658522.049626:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025241984 00000100:00100000:0.0:1788658522.049632:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025241600 00000100:00100000:0.0:1788658522.049640:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025241600 00000100:00100000:0.0:1788658522.049649:0:7958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025242112 00000100:00100000:0.0:1788658522.049651:0:7958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025242112 00000100:00100000:0.0:1788658522.049665:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788658522.049673:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025241728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658522.049732:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875544025241728:12345-0@lo:400:kworker.0 Request processed in 59us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658522.049739:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788658522.049755:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788658522.049760:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025242112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658522.049785:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025242112:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658522.049790:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788658522.049802:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788658522.049806:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875544025241472:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788658522.049812:0:7958:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788658522.049831:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875544025241472:12345-0@lo:400:kworker.0 Request processed in 24us (429us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788658522.049836:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788658522.049845:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788658522.049848:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875544025241984:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788658522.049852:0:7958:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788658522.049867:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875544025241984:12345-0@lo:400:kworker.0 Request processed in 18us (407us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788658522.049872:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788658522.049880:0:7958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788658522.049884:0:7958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875544025241600:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788658522.049893:0:7958:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788658522.049910:0:7958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3647:x1875544025241600:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788658522.049916:0:7958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788658522.049940:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658522.049954:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025241216:0@lo:400:kworker.0 00000400:00000100:0.0:1788658522.049977:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875544025241216 offset 0 length 224: 4 00000100:00100000:0.0:1788658522.049994:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025241856:0@lo:400:kworker.0 00000100:00100000:0.0:1788658522.050015:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658522.050032:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025242368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658522.050052:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658522.050079:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025241856 00000100:00100000:0.0:1788658522.050082:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025241856 00000100:00100000:0.0:1788658522.050110:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788658522.050115:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025241856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658522.050144:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025241856:12345-0@lo:400:kworker.0 Request processed in 29us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658522.050150:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788658522.050164:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025242368 00000100:00100000:0.0:1788658522.050167:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025242368 00000100:00100000:0.0:1788658522.050188:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788658522.050194:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025242368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788658522.050215:0:8456:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788658522.050241:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025242368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658522.050262:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1788658522.050296:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658522.050299:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658522.050324:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025241856:0@lo:400:kworker.0 00000100:00100000:0.0:1788658522.050337:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025242368:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788658522.050365:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788658522.050370:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a1d81ab8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788658522.050373:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00080000:1.0:1788658522.053044:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a1d834f1880 x1875544025241728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658522.053063:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025241728:0@lo:400:kworker.0 00000100:00100000:1.0:1788658522.053075:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025242240:0@lo:400:kworker.0 00000100:00100000:1.0:1788658522.053127:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658522.053178:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025241344:0@lo:38:kworker.0 00000100:00100000:1.0:1788658522.053203:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658522.053240:0:6541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025241344 00000100:00100000:1.0:1788658522.053258:0:6541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025241344 00000100:00100000:1.0:1788658522.053298:0:6541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788658522.053306:0:6541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025241344:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788658522.053326:0:6541:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788658522.053483:0:6541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025241344:12345-0@lo:38:kworker.0 Request processed in 176us (278us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788658522.053490:0:6541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:1.0:1788658522.053520:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3231800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658522.053525:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788658522.053537:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025241344:0@lo:38:kworker.0 00000100:00100000:1.0:1788658522.057032:0:13833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025242240 00000100:00100000:1.0:1788658522.057046:0:13833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025242240 00000100:00100000:1.0:1788658522.057151:0:13833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788658522.057161:0:13833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025242240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658522.057268:0:13833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025242240:12345-0@lo:400:kworker.0 Request processed in 109us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658522.057285:0:13833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1788658522.064801:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a1d81ab8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658522.064815:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 211 00000100:00080000:0.0:1788658522.064824:0:3647:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1d81ab8000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658522.064878:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83755c00 x1875544025242496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658522.064909:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025241600:0@lo:400:kworker.0 00010000:00080000:0.0:1788658522.064940:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8a1d834f3800 x1875544025242112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658538 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658522.064951:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025242112:0@lo:400:kworker.0 00000100:00080000:0.0:1788658522.064964:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788658522.064967:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a1ebd8b0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788658522.064970:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788658522.064974:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a1ebd8b0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658522.064977:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 189 00000100:00080000:0.0:1788658522.064981:0:3647:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a1ebd8b0800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658522.064992:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb2251880 x1875544025242624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658522.065013:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025241472:0@lo:400:kworker.0 00000100:00080000:0.0:1788658522.065026:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788658522.065029:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc0a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788658522.065033:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788658522.065035:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc0a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658522.065038:0:3647:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 231 00000100:00080000:0.0:1788658522.065041:0:3647:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a1ebdc0a000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658522.065051:0:3647:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7400a80 x1875544025242752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658522.065060:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025241984:0@lo:400:kworker.0 00000100:00100000:1.0:1788658522.065518:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025242240:0@lo:400:kworker.0 00000100:00100000:2.0:1788658522.065777:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025242496:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788658522.065840:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658522.066030:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875544025242624:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788658522.070032:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658522.070096:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025242752:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788658522.070125:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658522.071414:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025242496 00000100:00100000:2.0:1788658522.071427:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025242496 00000100:00100000:2.0:1788658522.071471:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025242624 00000100:00100000:2.0:1788658522.071473:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025242624 00000100:00100000:2.0:1788658522.071485:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025242752 00000100:00100000:2.0:1788658522.071488:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025242752 00000100:00100000:2.0:1788658522.071501:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788658522.071509:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025242496:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788658522.071532:0:6538:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788658522.071589:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025242496:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 79us (5747us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788658522.071611:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788658522.071627:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788658522.071631:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025242624:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788658522.071640:0:6538:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788658522.071663:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025242624:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (1639us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788658522.071668:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788658522.071676:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788658522.071681:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025242752:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788658522.071689:0:6538:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788658522.071722:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025242752:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (1596us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788658522.071727:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1788658522.071768:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d81ab8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658522.071773:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788658522.071777:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025242496:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788658522.071786:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebd8b0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658522.071790:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788658522.071793:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875544025242624:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788658522.071799:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc0a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658522.071802:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788658522.071805:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025242752:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788658522.559469:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025242880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658522.559534:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658522.559637:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025242880 00000100:00100000:1.0:1788658522.559644:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025242880 00000100:00100000:1.0:1788658522.559692:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788658522.559721:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025242880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658522.559749:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788658522.559787:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025242880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658522.559794:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788658522.559927:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025242880:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788658522.559973:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658523.582842:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658524.621495:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788658525.077849:0:15372:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788658525.106591:0:15372:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788658525.106649:0:15372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.106682:0:15372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.106688:0:15372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.106696:0:15372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.106745:0:15372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788658525.106751:0:15372:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788658525.106777:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788658525.106782:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788658525.106789:0:15372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788658525.106806:0:15372:0:(import.c:65:import_set_state_nolock()) ffff8a1ebd8b0800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788658525.106811:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788658525.106813:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788658525.106816:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788658525.107265:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658525.107281:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.107289:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658525.107293:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.107302:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658525.107308:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658525.107315:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788658525.107317:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788658525.107321:0:6524:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788658525.107358:0:6524:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.107365:0:6524:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658525.107397:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.107405:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1000/0x48e67cc629c6e917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e91e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.107419:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658525.107421:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658525.107423:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658525.108091:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025243008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658525.108161:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658525.108420:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025243008 00000100:00100000:2.0:1788658525.108428:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025243008 00000100:00100000:2.0:1788658525.108469:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788658525.108485:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875544025243008:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788658525.108492:0:6522:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658525 with bad export cookie 5253023205920531415 00010000:00010000:3.0:1788658525.109598:0:15372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.109615:0:15372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.109622:0:15372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.109629:0:15372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.109658:0:15372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658525.109673:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658525.109678:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.109685:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658525.109688:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.109696:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658525.109720:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658525.109726:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658525.109728:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788658525.109757:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.109763:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658525.109783:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.109789:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3400/0x48e67cc629c6e925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e92c expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.109814:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658525.109816:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658525.109824:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658525.109847:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658525.109859:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025243136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658525.113877:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658525.114178:0:15372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.114192:0:15372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.114200:0:15372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.114208:0:15372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.114273:0:15372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658525.114280:0:15372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.114288:0:15372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.114294:0:15372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.114309:0:15372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658525.114373:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025243136 00000100:00100000:1.0:1788658525.114383:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025243136 00000100:00100000:1.0:1788658525.114424:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658525.114433:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eae3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1875544025243136:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788658525.114440:0:9539:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658525 with bad export cookie 5253023205920531415 00000100:00100000:1.0:1788658525.114507:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eae3b9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3650:x1875544025243136:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (637us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788658525.114527:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788658525.114590:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788658525.114595:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1296000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788658525.114599:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.153@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788658525.119325:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658525.119342:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658525.119355:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3e00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658525.119360:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658525.119371:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658525.119380:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658525.119385:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658525.119407:0:6525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788658525.119411:0:6525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788658525.119680:0:15372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658525.119757:0:15372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6e4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.119766:0:15372:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6e4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.119772:0:15372:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6e4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.119779:0:15372:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.119806:0:15372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788658525.119811:0:15372:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1788658525.119815:0:15372:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:3.0:1788658525.119848:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658525.119853:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.119859:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658525.119862:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.119869:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658525.119876:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658525.119881:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788658525.119883:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788658525.119890:0:7486:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788658525.122583:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788658525.123398:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3648:x1875544025243008:12345-0@lo:103:ldlm_bl.0 Request processed in 14907us (15232us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788658525.123410:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788658525.123484:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.153@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788658525.135682:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.153@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788658525.135689:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788658525.135733:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d834f0e00 x1875544025241216/t0(0) o400->MGC192.168.202.153@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788658538 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658525.135750:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d83c20e00 x1875544025243008/t0(0) o103->MGC192.168.202.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658541 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658525.135761:0:3650:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1ebdb99c00 x1875544025243136/t0(0) o103->MGC192.168.202.153@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658541 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788658525.135770:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788658525.135774:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788658525.135775:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1788658525.136242:0:6525:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658525.136252:0:6525:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658525.136273:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658525.136282:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3e00/0x48e67cc629c6e7f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6e7f8 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658525.136525:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658525.136527:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658525.136530:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658525.136553:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658525.136572:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a017dcfd-fba9-49c7-bb83-f753e9511c6f:0:1875544025243264:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658525.137147:0:7486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.137158:0:7486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658525.137182:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.137191:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0200/0x48e67cc629c6eb8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x48e67cc629c6eb94 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658525.137202:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658525.137204:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658525.137205:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788658525.137227:0:15372:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788658525.137232:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788658525.137237:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658525.137243:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788658525.137248:0:15372:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8a1ebdc0d800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788658525.137255:0:15372:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8a1d821a2800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788658525.137260:0:15372:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8a1e8f254d40) has exports, disconnecting them 00000020:00080000:3.0:1788658525.137266:0:15372:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a1ebdc0d800), last request at 1788658522 00000020:00000080:3.0:1788658525.137274:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e7b9 00000100:00080000:3.0:1788658525.137292:0:15372:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc08800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788658525.137409:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788658525.137421:0:15372:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1ebdc0d800): rc 0 00000020:00000080:3.0:1788658525.137424:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ebdc0d800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788658525.137435:0:15372:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8a1d821a2800), last request at 1788658522 00000020:00000080:3.0:1788658525.137438:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e693 00000100:00080000:3.0:1788658525.137444:0:15372:0:(import.c:65:import_set_state_nolock()) ffff8a1d821a7000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788658525.137468:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788658525.137475:0:15372:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d821a2800): rc 0 00000020:00000080:3.0:1788658525.137477:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1d821a2800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788658525.137485:0:15372:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa33e41c97ae0 00000100:00080000:3.0:1788658525.137505:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788658525.137513:0:15372:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8a1d834f3480 x1875544025240960/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788658533 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658525.137523:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1788658525.138685:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a017dcfd-fba9-49c7-bb83-f753e9511c6f:0:1875544025243392:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788658525.139370:0:15372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788658525.139379:0:15372:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3231800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788658525.139526:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a1ec1296000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788658525.139558:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3648:1875544025243008:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788658525.139587:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdc0d800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788658525.139648:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d821a2800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788658525.139669:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ebdc08800 for lustre-MDT0001 00000020:00000080:2.0:1788658525.139675:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d821a7000 for lustre-MDT0001 00000100:00080000:1.0:1788658525.140517:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1296000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658525.140526:0:3650:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 169 00000100:00080000:1.0:1788658525.140545:0:3650:0:(import.c:665:import_select_connection()) MGC192.168.202.153@tcp: import ffff8a1ec1296000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658525.140594:0:3650:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f0700 x1875544025243520/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658525.141144:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3646:1875544025243520:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788658525.141195:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875544025243520 offset 0 length 520: 4 00000100:00100000:1.0:1788658525.141313:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025241216:0@lo:400:kworker.0 00000100:00100000:1.0:1788658525.141322:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025240960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658525.141347:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3650:1875544025243136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658525.141690:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658525.141694:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658525.141723:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658525.142608:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.142621:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2044000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658525.142626:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6e4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.142636:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6e4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658525.142643:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6e4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658525.142662:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788658525.142665:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788658525.142669:0:6524:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788658525.142683:0:6524:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1ec1296000 00010000:00010000:2.0:1788658525.142687:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6e4da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.142693:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6e4da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e4e1 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658525.142770:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658525.142772:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658525.142774:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788658525.143164:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788658525.143169:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1788658525.143229:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788658525.143288:0:15372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788658525.143380:0:15372:0:(import.c:65:import_set_state_nolock()) ffff8a1eb5e64800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788658525.143403:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788658525.143405:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788658525.143418:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788658525.143473:0:15372:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788658525.143482:0:15372:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7411800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788658525.143509:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8a1e8f254d40) has no exports 00000100:00100000:2.0:1788658525.144422:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025243648:0@lo:9:umount.0 00000100:00100000:2.0:1788658525.144492:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658525.144626:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025243648 00000100:00100000:3.0:1788658525.144634:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025243648 00000100:00100000:3.0:1788658525.144680:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788658525.144690:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875544025243648:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788658525.144748:0:8452:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e6ee 00000100:00080000:3.0:1788658525.144757:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdea5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788658525.144801:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788658525.144950:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3646:x1875544025243648:12345-0@lo:9:umount.0 Request processed in 261us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658525.144957:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1788658525.144989:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658525.145272:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025243776:0@lo:9:umount.0 00000100:00100000:2.0:1788658525.145374:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788658525.145428:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb5e64800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788658525.145467:0:10365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025243776 00000100:00100000:3.0:1788658525.145472:0:10365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025243776 00000100:00100000:3.0:1788658525.145502:0:10365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788658525.145510:0:10365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875544025243776:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788658525.145529:0:10365:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e822 00000100:00080000:3.0:1788658525.145548:0:10365:0:(import.c:65:import_set_state_nolock()) ffff8a1d82764000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788658525.145572:0:10365:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788658525.145655:0:10365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3646:x1875544025243776:12345-0@lo:9:umount.0 Request processed in 145us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658525.145661:0:10365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:3.0:1788658525.145677:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788658525.146491:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788658525.146661:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658525.146669:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025243648:0@lo:9:umount.0 00000100:00080000:2.0:1788658525.146693:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb7411800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788658525.146726:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788658525.146729:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658525.146732:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025243776:0@lo:9:umount.0 00000100:00080000:0.0:1788658525.146933:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658525.146937:0:6532:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:2.0:1788658525.159288:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8a1e8f254d40) has no exports 00000020:01000000:2.0:1788658525.224799:0:15372:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1d8251dba0 - data ffff8a1e9ee3f360/ffff8a1d8267d000 00000020:01000000:2.0:1788658525.224979:0:15372:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1e98990000 - data ffff8a1e9ec6faf8/ffff8a1eb339d000 00000001:00000004:1.0:1788658525.234338:0:15372:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788658525.276582:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658525.276591:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788658525.276600:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788658525.278537:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788658525.278547:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788658525.278827:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658525.278832:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788658525.279611:0:8603:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788658525.279618:0:8603:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788658525.279629:0:8603:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788658525.282259:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788658525.282266:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1788658525.282281:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658525.282283:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788658525.284680:0:9967:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788658525.284687:0:9967:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788658525.284698:0:9967:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788658525.294272:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e4fd 00000020:00000080:2.0:1788658525.294288:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ec1d91000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788658525.294757:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1d91000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788658525.296619:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e512 00000020:00000080:2.0:1788658525.296632:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ec1da4000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788658525.296677:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788658525.296682:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658525.296690:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788658525.296694:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8a1e8f2519c0) has no exports 00000004:01000000:2.0:1788658525.296962:0:15372:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788658525.296971:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e81b 00000020:00000080:2.0:1788658525.296975:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1eb7415000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788658525.297063:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1da4000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788658525.297154:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788658525.297159:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658525.297167:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788658525.297170:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8a1d821b99c0) has no exports 00000020:00000080:2.0:1788658525.297176:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e814 00000020:00000080:2.0:1788658525.297180:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1d8230a000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788658525.297357:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb7415000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788658525.297363:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d8230a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788658525.297614:0:15372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788658525.297619:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788658525.297627:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1788658525.297668:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658525.297670:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788658525.297747:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658525.297755:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788658525.297760:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e6d9 00000020:00000080:2.0:1788658525.297765:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1eb5e60000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788658525.297865:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb7411800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788658525.297871:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1d82600000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788658525.297873:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d82600000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788658525.297878:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788658525.298130:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788658525.298135:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658525.298140:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788658525.298143:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8a1eb2244d40) has no exports 00000020:00000080:2.0:1788658525.298148:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e6d2 00000020:00000080:2.0:1788658525.298151:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1e82e67000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788658525.298171:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb5e60000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:2.0:1788658525.298567:0:15372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788658525.298571:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788658525.298574:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1788658525.298578:0:15372:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658525.298580:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788658525.298654:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1e82e67000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788658525.298774:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658525.298790:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788658525.298801:0:15372:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788658525.298808:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e535 00000020:00000080:2.0:1788658525.298813:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1eb3235000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788658525.298883:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb5e64800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788658525.298889:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1d81abd800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788658525.298891:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d81abd800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788658525.298969:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788658525.299149:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788658525.299154:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658525.299159:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788658525.299162:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8a1e84453380) has no exports 00000020:00000080:2.0:1788658525.299167:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e52e 00000020:00000080:2.0:1788658525.299170:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1eb3234800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788658525.299190:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb3235000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788658525.300410:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb3234800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788658525.300854:0:15372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1788658525.300860:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788658525.300864:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:3.0:1788658525.300871:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658525.300962:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1eb3231800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788658525.301022:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658525.301033:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788658525.301093:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1eabc2d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788658525.301096:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eabc2d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788658525.301104:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788658525.301251:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658525.301255:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788658525.301257:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ec1d90000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788658525.301259:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1d90000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788658525.301264:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788658525.301424:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e519 00000020:00000080:3.0:1788658525.301431:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ec1da6000/lustre-MDD0001_UUID 00000020:01000000:3.0:1788658525.301549:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788658525.301553:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658525.301559:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788658525.301563:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8a1e8f250000) has no exports 00000020:00000080:3.0:1788658525.301581:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658525.301585:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788658525.301589:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e520 00000020:00000080:3.0:1788658525.301603:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ec1da3800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788658525.301642:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1da6000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788658525.301646:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1eabc56000/lustre-MDD0001_UUID 00000020:00000080:0.0:1788658525.301648:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eabc56000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788658525.301652:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788658525.302103:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1da3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:3.0:1788658525.302142:0:15372:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1ec11f4800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788658525.302146:0:15372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1ec11f4800 2 00000020:01000004:3.0:1788658525.302149:0:15372:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1ec11f4800 from lustre-MDT0001 00000020:00000080:3.0:1788658525.302166:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658525.302171:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788658525.302174:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ec1d95000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788658525.302176:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1d95000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788658525.302182:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788658525.302211:0:15372:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788658525.302214:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788658525.302217:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658525.302219:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788658525.302226:0:15372:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8a1ebd8b0000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788658525.302231:0:15372:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8a1ebd884d40) has exports, disconnecting them 00000020:00080000:3.0:1788658525.302236:0:15372:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8a1ebd8b0000), last request at 1788658272 00000020:00000080:3.0:1788658525.302241:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e574 00000020:00080000:3.0:1788658525.302251:0:15372:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1ebd8b0000): rc 0 00000020:00000080:3.0:1788658525.302254:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ebd8b0000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788658525.303426:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebd8b0000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788658525.309758:0:15372:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788658525.309769:0:15372:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658525.309841:0:15372:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788658525.309849:0:15372:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658525.310066:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ebd8b0800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788658525.310230:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658525.310239:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788658525.310247:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1eabc53800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788658525.310251:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eabc53800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788658525.310256:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788658525.310399:0:15372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1ec11f4800 1 00000020:00000080:2.0:1788658525.310407:0:15372:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e4b0 00000020:00000080:2.0:1788658525.310417:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ec11f3000/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788658525.310431:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788658525.310434:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658525.310439:0:15372:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788658525.310443:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8a1eb23f4d40) has no exports 00000020:00000080:0.0:1788658525.310550:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec11f3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788658525.335176:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658525.335189:0:15372:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788658525.335195:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ec11f2000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788658525.335200:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec11f2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788658525.335211:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788658525.335324:0:15372:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1ec11f0800 00000020:01000000:3.0:1788658525.335338:0:15372:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788658525.335341:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658525.335344:0:15372:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788658525.335347:0:15372:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8a1eae3919c0) has no exports 00000100:00100000:2.0:1788658525.335470:0:6538:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8a1ec11fea00:6538] 2 exiting: rc = 0 00000100:00100000:1.0:1788658525.335517:0:6536:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8a1e84e17600:6536] 0 exiting: rc = 1 00000100:00100000:1.0:1788658525.335589:0:7958:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8a1eb23ce000:7958] 3 exiting: rc = 0 00000100:00100000:2.0:1788658525.335590:0:6537:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8a1ec11fee00:6537] 1 exiting: rc = 0 00000100:00100000:0.0:1788658525.335680:0:11974:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8a1d826c9600:11974] 4 exiting: rc = 0 00000100:00100000:3.0:1788658525.336154:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336162:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336182:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336188:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336194:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336200:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336206:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336212:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336218:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336224:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336229:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336241:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336248:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336254:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336259:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336265:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336270:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336276:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336281:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336353:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336359:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336365:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336369:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336375:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336380:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336385:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336390:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336394:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336400:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336404:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336409:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336414:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336418:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336424:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336429:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336434:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336438:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336451:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336456:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336460:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336465:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336470:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336475:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336480:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336485:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336491:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336496:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336502:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336507:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336513:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336517:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336522:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336531:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336536:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336542:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336547:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336552:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336557:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336563:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336569:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336575:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336581:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336586:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.336592:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.347587:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a1ec11ff000:6540] 1 exiting: rc = 0 00000100:00100000:1.0:1788658525.347736:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a1e83976c00:6539] 0 exiting: rc = 1 00000100:00100000:2.0:1788658525.350512:0:13563:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8a1d81b0ce00:13563] 2 exiting: rc = 0 00000100:00100000:1.0:1788658525.350751:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350762:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350768:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350774:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350780:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350786:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350792:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350797:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350803:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350809:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350815:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350821:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350829:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350834:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350839:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350844:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350849:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350855:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350860:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350866:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350871:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350876:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350882:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350886:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350891:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350896:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350902:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350906:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350924:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350930:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350935:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350939:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350944:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350949:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350954:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350959:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350964:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350970:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350975:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350980:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350986:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.350992:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351008:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351013:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351019:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351024:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351030:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351036:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351041:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351047:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351052:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351058:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351063:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351069:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351075:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351080:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351085:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351090:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351095:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351100:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351105:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351110:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351115:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.351128:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658525.351804:0:7782:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8a1eb23cfe00:7782] 2 exiting: rc = 0 00000100:00100000:2.0:1788658525.351874:0:6541:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8a1e83977a00:6541] 0 exiting: rc = 1 00000100:00100000:2.0:1788658525.352851:0:6542:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8a1ec11ff600:6542] 1 exiting: rc = 0 00000100:00100000:1.0:1788658525.352979:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.352990:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353008:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353016:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353022:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353028:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353035:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353042:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353049:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353057:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353080:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353088:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353093:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353100:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353105:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353111:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353117:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353124:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353130:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353136:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353142:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353149:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353171:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353179:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353185:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353191:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353198:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353204:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353210:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353216:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353222:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353227:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353233:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.353239:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354434:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354451:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354455:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354459:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354464:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354468:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354472:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354476:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354480:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354484:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354488:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354493:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354514:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354522:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354528:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354537:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354544:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354550:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354556:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354563:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354570:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354577:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354582:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354587:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354601:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354607:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354611:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354616:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354620:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.354624:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.367306:0:6543:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a1ea0dcb400:6543] 0 exiting: rc = 1 00000100:00100000:0.0:1788658525.367681:0:6544:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a1e88a24a00:6544] 1 exiting: rc = 0 00000100:00100000:1.0:1788658525.368609:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368618:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368623:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368628:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368646:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368652:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368657:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368662:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368667:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368672:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368677:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368681:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368686:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368690:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368695:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368885:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368895:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368900:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368905:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368909:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368914:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368919:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368924:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368929:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368934:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368940:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368946:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368952:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368957:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368963:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368969:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368975:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368981:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.368986:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369002:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369010:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369015:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369020:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369025:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369038:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369043:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369048:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369053:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369057:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369063:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369068:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369073:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369078:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369083:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369088:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369093:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369098:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369103:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369108:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369113:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369118:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369123:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369128:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369132:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369137:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369141:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369147:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369343:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.369353:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658525.370039:0:6545:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a1e88a24800:6545] 0 exiting: rc = 1 00000100:00100000:0.0:1788658525.370158:0:6546:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a1eadbc9600:6546] 1 exiting: rc = 0 00000100:00100000:1.0:1788658525.370266:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370273:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370354:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370361:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370367:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370373:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370379:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370385:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370391:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370397:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370414:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370419:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370424:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370430:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370436:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370442:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370447:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370452:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370458:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370463:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370469:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370474:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370480:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370485:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370489:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370495:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370499:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370504:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370508:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370513:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370519:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370524:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370529:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370534:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370540:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370545:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370550:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370556:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370562:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370567:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370574:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370580:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370585:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370591:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370596:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370609:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370615:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370620:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370625:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370631:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370636:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370641:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370646:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370650:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370655:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370660:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370666:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370670:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370676:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370681:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370687:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370692:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370697:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.370975:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658525.371657:0:6547:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a1e8f2bac00:6547] 0 exiting: rc = 1 00000100:00100000:3.0:1788658525.371970:0:6548:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a1e8f2bbc00:6548] 1 exiting: rc = 0 00000100:00100000:1.0:1788658525.372132:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372138:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372144:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372150:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372155:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372161:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372167:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372172:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372179:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372185:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372191:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372196:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372202:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372207:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372213:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372219:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372235:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372241:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372246:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372252:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372257:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372263:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372268:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372274:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372352:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372358:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372364:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372369:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372373:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372377:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372382:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372387:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372392:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372398:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372403:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372408:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372413:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372418:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372424:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372429:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372434:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372439:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372445:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372450:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372455:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372461:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372466:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372471:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372477:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372483:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372489:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372501:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372506:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372510:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372515:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372520:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372526:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372531:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372675:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372684:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372689:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372695:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372876:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.372886:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658525.373829:0:6549:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8a1e8f2a0000:6549] 0 exiting: rc = 1 00000100:00100000:3.0:1788658525.374175:0:6551:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8a1e82ef9000:6551] 2 exiting: rc = 0 00000100:00100000:0.0:1788658525.374587:0:6550:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8a1e88a24200:6550] 1 exiting: rc = 0 00000100:00100000:1.0:1788658525.374803:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374814:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374821:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374827:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374833:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374840:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374848:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374855:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374861:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374868:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374874:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374880:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374887:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374893:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374900:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374906:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374911:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374917:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374923:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374928:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374934:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374939:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374959:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374966:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.374988:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375006:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375012:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375017:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375023:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375029:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375035:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375041:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375048:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375054:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375061:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375067:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375072:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375078:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375085:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375091:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375097:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375104:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375109:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375115:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375121:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375127:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375132:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375138:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375175:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375182:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375188:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375193:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375198:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375203:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375209:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375215:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375221:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375234:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375240:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375246:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375252:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375258:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375265:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658525.375272:0:15372:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788658525.380363:0:15372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658525.380375:0:15372:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788658525.380382:0:15372:0:(genops.c:885:class_export_put()) final put ffff8a1ec1294000/MDS_uuid 00000020:00000080:1.0:1788658525.380388:0:15372:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1294000/MDS_uuid for MDS 00000020:01000000:1.0:1788658525.380393:0:15372:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788658525.380545:0:15372:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788658525.637776:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658526.657577:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658527.167312:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658527.167322:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658527.167326:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658527.167329:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788658527.167333:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1d81ab8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658527.167340:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1788658527.167346:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788658527.167355:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1d81ab8000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658527.167397:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7401c00 x1875544025243904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658527.167476:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025243904:0@lo:38:kworker.0 00000400:00000100:2.0:1788658527.167529:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025243904 offset 0 length 520: 4 00000100:00080000:0.0:1788658527.167664:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658527.167668:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788658527.167670:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc0a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658527.167674:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1788658527.167677:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788658527.167681:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a1ebdc0a000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658527.167694:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7400700 x1875544025244160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658527.167724:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025244032:0@lo:400:kworker.0 00000400:00000100:1.0:1788658527.167760:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025244032 offset 0 length 224: 4 00000100:00100000:2.0:1788658527.172234:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025244160:0@lo:38:kworker.0 00000400:00000100:2.0:1788658527.172303:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025244160 offset 0 length 520: 4 00000100:00100000:0.0:1788658527.173658:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658527.173674:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025244288:0@lo:400:kworker.0 00000400:00000100:0.0:1788658527.173729:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025244288 offset 0 length 224: 4 00010000:00010000:0.0:1788658527.680280:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658528.705010:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658529.730041:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658530.174845:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658530.174859:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658530.174864:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658530.175332:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658530.175413:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658530.175418:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788658530.175468:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658530.175857:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658530.175891:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025244544:0@lo:400:kworker.0 00000400:00000100:1.0:1788658530.176124:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025244544 offset 0 length 224: 4 00000100:00100000:0.0:1788658530.177078:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025244416:0@lo:400:kworker.0 00000400:00000100:0.0:1788658530.177125:0:3649:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025244416 offset 0 length 224: 4 00000020:01000004:1.0:1788658530.258529:0:15573:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788658530.285134:0:15573:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788658530.285207:0:15573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658530.285225:0:15573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658530.285233:0:15573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658530.285240:0:15573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658530.285288:0:15573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658530.285388:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658530.285397:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658530.285405:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658530.285415:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658530.285426:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658530.285434:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658530.285441:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788658530.285444:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:2.0:1788658530.285459:0:6524:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1ec1296000 00010000:00010000:2.0:1788658530.285463:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658530.285470:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3200/0x48e67cc629c6e8fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e902 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658530.285483:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658530.285485:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658530.285487:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788658530.285587:0:15573:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:1.0:1788658530.285593:0:15573:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788658530.285623:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658530.285637:0:15573:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb7401c00 x1875544025243904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658542 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658530.285664:0:15573:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788658530.285672:0:15573:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788658530.285680:0:15573:0:(import.c:65:import_set_state_nolock()) ffff8a1d81ab8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788658530.285685:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658530.285690:0:15573:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb7401c00 x1875544025243904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658542 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658530.285696:0:15573:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788658530.285699:0:15573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1788658530.285975:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025243904:0@lo:38:kworker.0 00000100:00080000:1.0:1788658530.288687:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788658530.288762:0:15573:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb7402a00 x1875544025244032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658543 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658530.288790:0:15573:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb7403100 x1875544025244416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658530.288809:0:15573:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1788658530.289129:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025244032:0@lo:400:kworker.0 00000100:00080000:1.0:1788658530.289162:0:15573:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788658530.289207:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875544025244416:0@lo:400:kworker.0 00000100:00080000:1.0:1788658530.296621:0:15573:0:(import.c:65:import_set_state_nolock()) ffff8a1d81aba800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788658530.296721:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875544025244672:0@lo:39:umount.0 00000400:00000100:2.0:1788658530.296799:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025244672 offset 0 length 224: 4 00010000:00010000:0.0:1788658530.751350:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788658530.754196:0:8447:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788658530.754208:0:8447:0:(genops.c:885:class_export_put()) final put ffff8a1ebdea3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788658530.754289:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdea3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788658530.754441:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ebdea5000 for lustre-OST0000 00000001:00100000:2.0:1788658530.754603:0:9530:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788658530.754608:0:9530:0:(genops.c:885:class_export_put()) final put ffff8a1d82763000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788658530.754660:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d82763000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788658530.754770:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d82764000 for lustre-OST0001 00010000:00010000:3.0:1788658531.774907:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788658532.223474:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788658532.223490:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658532.223495:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788658532.223499:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788658532.223622:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658532.228301:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025244800:0@lo:400:kworker.0 00000400:00000100:0.0:1788658532.228390:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025244800 offset 0 length 224: 4 00010000:00010000:0.0:1788658532.809495:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658533.823004:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658534.847307:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658535.423333:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658525/real 1788658525] req@ffff8a1d834f0700 x1875544025243520/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788658535 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658535.423377:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d834f0700 x1875544025243520/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788658535 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658535.423404:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1296000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658535.423442:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788658535.423448:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3646:1875544025243520:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1788658535.423676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658535.423732:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788658535.423735:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1296000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658535.423741:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 442 00000100:00080000:0.0:1788658535.423747:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.153@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788658535.423756:0:37:0:(import.c:665:import_select_connection()) MGC192.168.202.153@tcp: import ffff8a1ec1296000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658535.423795:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7403b80 x1875544025244928/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788658535.423822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658535.423827:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788658535.423942:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658535.423960:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025245056:0@lo:400:kworker.0 00000400:00000100:1.0:1788658535.424031:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025245056 offset 0 length 224: 4 00000100:00100000:2.0:1788658535.424779:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3646:1875544025244928:0@lo:250:kworker.0 00000400:00000100:2.0:1788658535.424814:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875544025244928 offset 0 length 520: 4 00010000:00010000:3.0:1788658535.871769:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658536.896077:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658537.923742:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658538.945642:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658539.968225:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658540.479937:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658540.479954:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658540.479958:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788658540.479963:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788658540.480155:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025245184:0@lo:400:kworker.0 00000400:00000100:1.0:1788658540.480250:0:3650:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025245184 offset 0 length 224: 4 00000100:00100000:2.0:1788658540.542899:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658530/real 1788658530] req@ffff8a1d834f1180 x1875544025244672/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658540 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658540.542944:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d834f1180 x1875544025244672/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658540 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658540.542971:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d81aba800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788658540.543001:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875544025244672:0@lo:39:umount.0 00000100:00080000:1.0:1788658540.543285:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788658540.543292:0:15573:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788658540.543299:0:15573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788658540.544363:0:15573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658540.544381:0:15573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658540.544390:0:15573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658540.544398:0:15573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658540.545573:0:15573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658540.545596:0:15573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658540.545609:0:15573:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658540.545617:0:15573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658540.545624:0:15573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658540.549795:0:15373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658540.549839:0:15573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788658540.549854:0:15573:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788658540.549916:0:15573:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788658540.549923:0:15573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788658540.549937:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658540.549945:0:15573:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788658540.549952:0:15573:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8a1ebd883380) has no exports 00000020:00080000:1.0:1788658540.549988:0:15573:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8a1ebd883380) has no exports 00000020:01000000:1.0:1788658540.554264:0:15573:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1d83312de0 - data ffff8a1e9ec24948/ffff8a1d83440000 00000020:01000000:1.0:1788658540.556163:0:15573:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1e9887c0c0 - data ffff8a1e9ee84798/ffff8a1d82461400 00010000:00010000:2.0:1788658540.556482:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658540.556496:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658540.556509:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec21d1e00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658540.556515:0:6524:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658540.556528:0:6524:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658540.556561:0:6524:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658540.556568:0:6524:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788658540.556571:0:6524:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788658540.556575:0:6524:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788658540.556597:0:6524:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1ec1296000 00010000:00010000:2.0:1788658540.556602:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658540.556609:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec21d1e00/0x48e67cc629c6eb7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6eb86 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658540.556623:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658540.556625:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658540.556628:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658540.557576:0:15373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658540.557591:0:15373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658540.557595:0:15373:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658540.557604:0:15373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658540.557627:0:15373:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658540.557633:0:15373:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658540.557636:0:15373:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788658540.557639:0:15373:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788658540.557652:0:15373:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1ec1296000 00010000:00010000:0.0:1788658540.557656:0:15373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658540.557663:0:15373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b2000/0x48e67cc629c6e909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e910 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658540.557676:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658540.557678:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658540.557680:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788658540.566336:0:15573:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788658540.584035:0:15573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e64d 00000020:00000080:0.0:1788658540.584053:0:15573:0:(genops.c:885:class_export_put()) final put ffff8a1eb3236800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788658540.584076:0:15573:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1ebd8b1800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788658540.584082:0:15573:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1ebd8b1800 2 00000020:01000004:0.0:1788658540.584085:0:15573:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1ebd8b1800 from lustre-OST0000 00000020:00000080:0.0:1788658540.584113:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658540.584127:0:15573:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788658540.584130:0:15573:0:(genops.c:885:class_export_put()) final put ffff8a1ec1da0800/lustre-OST0000_UUID 00000020:00000080:0.0:1788658540.584134:0:15573:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1da0800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788658540.584142:0:15573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788658540.584224:0:15573:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788658540.584229:0:15573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788658540.584234:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658540.584239:0:15573:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788658540.584261:0:15573:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a1d82309000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658540.584267:0:15573:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8a1d821bcd40) has exports, disconnecting them 00000020:00080000:0.0:1788658540.584272:0:15573:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a1d82309000), last request at 1788658294 00000020:00000080:0.0:1788658540.584277:0:15573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e677 00000020:00080000:0.0:1788658540.584286:0:15573:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d82309000): rc 0 00000020:00000080:0.0:1788658540.584294:0:15573:0:(genops.c:885:class_export_put()) final put ffff8a1d82309000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788658540.585194:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb3236800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788658540.585217:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d82309000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788658540.585256:0:15573:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788658540.585262:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658540.585268:0:15573:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788658540.585275:0:15573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788658540.585455:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658540.585465:0:15573:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788658540.585472:0:15573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788658540.585478:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658540.585482:0:15573:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788658540.585489:0:15573:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8a1ebd9ac800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788658540.585507:0:15573:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8a1eb22419c0) has exports, disconnecting them 00000020:00080000:2.0:1788658540.585512:0:15573:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8a1ebd9ac800), last request at 1788658294 00000020:00000080:2.0:1788658540.585517:0:15573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e68c 00000020:00080000:2.0:1788658540.585535:0:15573:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1ebd9ac800): rc 0 00000020:00000080:2.0:1788658540.585541:0:15573:0:(genops.c:885:class_export_put()) final put ffff8a1ebd9ac800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788658540.586400:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d81ab8000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788658540.586423:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1d81abf800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788658540.586427:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d81abf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788658540.586441:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788658540.586521:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebd9ac800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788658540.587063:0:15573:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788658540.587069:0:15573:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788658540.587074:0:15573:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788658540.587081:0:15573:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788658540.587105:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1d81aba800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788658540.587510:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658540.587523:0:15573:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788658540.587529:0:15573:0:(genops.c:885:class_export_put()) final put ffff8a1ebd9aa800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788658540.587532:0:15573:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebd9aa800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788658540.587537:0:15573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788658540.587589:0:15573:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1ebd8b1800 1 00000020:00000080:3.0:1788658540.587595:0:15573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e615 00000020:00000080:3.0:1788658540.587602:0:15573:0:(genops.c:885:class_export_put()) final put ffff8a1ebd93f800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788658540.587614:0:15573:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788658540.587634:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebd93f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788658540.587645:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658540.587650:0:15573:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788658540.587655:0:15573:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8a1ebd880000) has no exports 00000020:00000080:3.0:1788658540.695779:0:15573:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658540.695798:0:15573:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788658540.695806:0:15573:0:(genops.c:885:class_export_put()) final put ffff8a1ebd8b3000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788658540.695812:0:15573:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebd8b3000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788658540.695830:0:15573:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788658540.696404:0:15573:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1ebd8b6800 00000020:02000400:3.0:1788658540.712787:0:15573:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788658540.990994:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658542.014905:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658542.590836:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658527/real 1788658527] req@ffff8a1eb7400700 x1875544025244160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788658542 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658542.590883:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1eb7400700 x1875544025244160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788658542 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658542.590912:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc0a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658542.590947:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788658542.590952:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025244160:0@lo:38:kworker.0 00000100:00080000:1.0:1788658542.591089:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658542.591096:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658542.591099:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788658542.591102:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788658542.591106:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc0a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658542.591113:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 444 00000100:00080000:1.0:1788658542.591122:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788658542.591131:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a1ebdc0a000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658542.591181:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f1880 x1875544025245312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658542.591264:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658542.591280:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025245440:0@lo:400:kworker.0 00000400:00000100:1.0:1788658542.591351:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025245440 offset 0 length 224: 4 00000100:00100000:3.0:1788658542.592738:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025245312:0@lo:38:kworker.0 00000400:00000100:3.0:1788658542.592796:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025245312 offset 0 length 520: 4 00010000:00010000:2.0:1788658543.038971:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788658543.556058:0:3650:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658527/real 1788658527] req@ffff8a1eb7400e00 x1875544025244288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658543 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658543.593929:0:3650:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8a1eb7400e00 x1875544025244288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788658543 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788658543.593950:0:3650:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc08000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788658543.593955:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788658543.614514:0:3650:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1788658543.614593:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025244288:0@lo:400:kworker.0 00000100:00080000:3.0:1788658543.614951:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788658543.614958:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658543.614961:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788658543.614964:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658543.614994:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788658543.614999:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788658543.615003:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc08000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658543.615010:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 231 00000100:00080000:3.0:1788658543.615020:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a1ebdc08000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658543.615067:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb98000 x1875544025245568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658543.615124:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875544025245568:0@lo:38:kworker.0 00000400:00000100:3.0:1788658543.615191:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544025245568 offset 0 length 520: 4 00010000:00010000:0.0:1788658544.074123:0:15373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788658544.419095:0:15776:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788658544.432903:0:15776:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788658544.433011:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658544.433028:0:15776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658544.433036:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658544.433044:0:15776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658544.433091:0:15776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788658544.433097:0:15776:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788658544.433130:0:15776:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658544.433144:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d834f1880 x1875544025245312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658562 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.433161:0:15776:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788658544.433168:0:15776:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788658544.433177:0:15776:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc0a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788658544.433182:0:15776:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658544.433186:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d834f1880 x1875544025245312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658562 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.433192:0:15776:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788658544.433196:0:15776:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:3.0:1788658544.433292:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025245312:0@lo:38:kworker.0 00000100:00080000:0.0:1788658544.434227:0:15776:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788658544.434239:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb7401880 x1875544025244544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.434269:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1ebdb99180 x1875544025244800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658548 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.434293:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb7402d80 x1875544025245056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658551 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.434308:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb7403100 x1875544025245184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658556 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.434317:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d834f3480 x1875544025245440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658558 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.434327:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1ebdb98000 x1875544025245568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658553 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.434356:0:15776:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788658544.434408:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025245184:0@lo:400:kworker.0 00000100:00100000:0.0:1788658544.434417:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025245056:0@lo:400:kworker.0 00000100:00080000:0.0:1788658544.434445:0:15776:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788658544.434451:0:15776:0:(import.c:65:import_set_state_nolock()) ffff8a1ebdc08000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788658544.434457:0:15776:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788658544.434461:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb7401880 x1875544025244544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658546 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.434470:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1ebdb99180 x1875544025244800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658548 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.434478:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1d834f3480 x1875544025245440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658558 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.434485:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1ebdb98000 x1875544025245568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658553 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658544.434492:0:15776:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788658544.434495:0:15776:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00010000:00010000:1.0:1788658544.434644:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658544.434655:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.434664:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97600 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658544.434668:0:6525:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.434679:0:6525:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658544.434687:0:6525:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658544.434692:0:6525:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788658544.434694:0:6525:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788658544.434730:0:6525:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788658544.434752:0:6525:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1ec1296000 00010000:00010000:1.0:1788658544.434757:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.434765:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97600/0x48e67cc629c6e8df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e8e6 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.434780:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658544.434782:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658544.434784:0:6525:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658544.434907:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025244800:0@lo:400:kworker.0 00000100:00100000:3.0:1788658544.435001:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025245440:0@lo:400:kworker.0 00000100:00100000:3.0:1788658544.435010:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025244544:0@lo:400:kworker.0 00000100:00100000:3.0:1788658544.435034:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875544025245568:0@lo:38:kworker.0 00010000:00010000:1.0:1788658544.436175:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.436193:0:15776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.436216:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.436224:0:15776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.436290:0:15776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658544.436299:0:15776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.436305:0:15776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.436312:0:15776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658544.436318:0:15776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658544.436529:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658544.436538:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658544.436547:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97200 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658544.436551:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658544.436559:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658544.436567:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658544.436585:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658544.436588:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788658544.436600:0:7486:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1ec1296000 00010000:00010000:3.0:1788658544.436603:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658544.436611:0:7486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97200/0x48e67cc629c6e8ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e8f4 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658544.436627:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658544.436630:0:7486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658544.436635:0:7486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419e00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658544.436638:0:7486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658544.436644:0:7486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658544.436650:0:7486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658544.436654:0:7486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788658544.436656:0:7486:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788658544.436659:0:7486:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1ec1296000 00010000:00010000:3.0:1788658544.436662:0:7486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658544.436678:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658544.436680:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658544.436682:0:7486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658544.436959:0:15776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658544.436966:0:15776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6eb71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6eb78 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658544.436984:0:15776:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788658544.436989:0:15776:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788658544.436992:0:15776:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788658544.437032:0:15776:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788658544.437038:0:15776:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1788658544.437088:0:6524:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788658544.437101:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658544.437109:0:15776:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788658544.437114:0:15776:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8a1d82778000) has no exports 00000020:00080000:2.0:1788658544.437144:0:15776:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8a1d82778000) has no exports 00000020:01000000:2.0:1788658544.439566:0:15776:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1d833124e0 - data ffff8a1e9ef23438/ffff8a1d83443000 00000020:01000000:2.0:1788658544.440913:0:15776:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a1d820fe240 - data ffff8a1e9ee77288/ffff8a1d83475800 00100000:10000000:2.0:1788658544.465051:0:15776:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788658544.481425:0:15776:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e773 00000020:00000080:0.0:1788658544.481443:0:15776:0:(genops.c:885:class_export_put()) final put ffff8a1eb5e67000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788658544.481469:0:15776:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1d8230c000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788658544.481474:0:15776:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1d8230c000 2 00000020:01000004:0.0:1788658544.481478:0:15776:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a1d8230c000 from lustre-OST0001 00000020:00000080:0.0:1788658544.481510:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658544.481526:0:15776:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788658544.481530:0:15776:0:(genops.c:885:class_export_put()) final put ffff8a1eb5e67800/lustre-OST0001_UUID 00000020:00000080:0.0:1788658544.481533:0:15776:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb5e67800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788658544.481560:0:15776:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788658544.481889:0:15776:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a017dcfd-fba9-49c7-bb83-f753e9511c6f->MGS 00010000:00010000:0.0:1788658544.481911:0:15776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6e4cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e4d3 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658544.481925:0:15776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6e4cc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e4d3 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658544.481932:0:15776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788658544.481936:0:15776:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788658544.481941:0:15776:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788658544.481960:0:15776:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1ec1296000 00010000:00010000:0.0:1788658544.481965:0:15776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6e4cc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e4d3 expref: -99 pid: 7465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658544.481984:0:15776:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3c00/0x48e67cc629c6e94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x48e67cc629c6e956 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658544.481991:0:15776:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3c00/0x48e67cc629c6e94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x48e67cc629c6e956 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658544.481997:0:15776:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658544.481999:0:15776:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788658544.482001:0:15776:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788658544.482012:0:15776:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a1ec1296000 00010000:00010000:0.0:1788658544.482015:0:15776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1eb23b3c00/0x48e67cc629c6e94f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x48e67cc629c6e956 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658544.482035:0:15776:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1296000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788658544.482040:0:15776:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788658544.482042:0:15776:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788658544.482052:0:15776:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788658544.482057:0:15776:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788658544.482073:0:15776:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a1eb7403b80 x1875544025244928/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788658550 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788658544.482092:0:15776:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788658544.482096:0:15776:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:1.0:1788658544.482180:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1eb5e67000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788658544.482282:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a017dcfd-fba9-49c7-bb83-f753e9511c6f:3646:1875544025244928:0@lo:250:kworker.0 10000000:01000000:0.0:1788658544.482358:0:15776:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788658544.482380:0:15776:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e3c9 00000020:00000080:0.0:1788658544.482387:0:15776:0:(genops.c:885:class_export_put()) final put ffff8a1ec1293800/a017dcfd-fba9-49c7-bb83-f753e9511c6f 00000020:01000000:0.0:1788658544.482433:0:15776:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.153@tcp (flags='') 00000020:00000080:0.0:1788658544.482439:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658544.482447:0:15776:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.153@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788658544.482452:0:15776:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8a1eae393380) has no exports 10000000:01000000:3.0:1788658544.483872:0:6534:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788658544.484167:0:15776:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.153@tcp: client import never connected 00000100:00080000:0.0:1788658544.484173:0:15776:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788658544.484178:0:15776:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788658544.484182:0:15776:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788658544.484186:0:15776:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788658544.484290:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1293800/a017dcfd-fba9-49c7-bb83-f753e9511c6f for MGC192.168.202.153@tcp 00000020:00000080:0.0:1788658544.484688:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658544.484735:0:15776:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.153@tcp (uuid a017dcfd-fba9-49c7-bb83-f753e9511c6f) 00000020:01000000:0.0:1788658544.484862:0:15776:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788658544.484869:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658544.484876:0:15776:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788658544.484885:0:15776:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a1ebdc0b800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788658544.484893:0:15776:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8a1eb23f3380) has exports, disconnecting them 00000020:00080000:0.0:1788658544.484899:0:15776:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a1ebdc0b800), last request at 1788658314 00000020:00000080:0.0:1788658544.484905:0:15776:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e79d 00000020:00080000:0.0:1788658544.484923:0:15776:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1ebdc0b800): rc 0 00000020:00000080:0.0:1788658544.484929:0:15776:0:(genops.c:885:class_export_put()) final put ffff8a1ebdc0b800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788658544.485936:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ec1296000 for MGC192.168.202.153@tcp 00000020:00000080:1.0:1788658544.485953:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1ec1295800/a017dcfd-fba9-49c7-bb83-f753e9511c6f 00000020:00000080:1.0:1788658544.485957:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ec1295800/a017dcfd-fba9-49c7-bb83-f753e9511c6f for MGC192.168.202.153@tcp 00000020:01000000:1.0:1788658544.485964:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.153@tcp (a017dcfd-fba9-49c7-bb83-f753e9511c6f) 00000020:00000080:1.0:1788658544.486317:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdc0b800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788658544.488422:0:15776:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788658544.488434:0:15776:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658544.488440:0:15776:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788658544.488450:0:15776:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788658544.488837:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ebdc0a000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788658544.488954:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658544.488966:0:15776:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788658544.488973:0:15776:0:(genops.c:885:class_export_put()) final put ffff8a1ebdc0e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788658544.488977:0:15776:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdc0e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788658544.488985:0:15776:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1788658544.489088:0:15776:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788658544.489094:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658544.489100:0:15776:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788658544.489109:0:15776:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8a1d82760000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788658544.489116:0:15776:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8a1eb23f19c0) has exports, disconnecting them 00000020:00080000:1.0:1788658544.489122:0:15776:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8a1d82760000), last request at 1788658314 00000020:00000080:1.0:1788658544.489127:0:15776:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e7b2 00000020:00080000:1.0:1788658544.489145:0:15776:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a1d82760000): rc 0 00000020:00000080:1.0:1788658544.489151:0:15776:0:(genops.c:885:class_export_put()) final put ffff8a1d82760000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788658544.489743:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d82760000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788658544.500442:0:15776:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788658544.500454:0:15776:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788658544.500460:0:15776:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788658544.500483:0:15776:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788658544.500638:0:15373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788658544.500986:0:6525:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788658544.501196:0:7486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788658544.501343:0:6524:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1788658544.501516:0:6520:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a1e82eada00:6520] 1 exiting: rc = 0 00000100:00100000:2.0:1788658544.501618:0:6519:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a1ea19f5000:6519] 0 exiting: rc = 1 00000100:00100000:1.0:1788658544.501861:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.502171:0:6521:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a1e86965000:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1788658544.502242:0:6523:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a1e82eade00:6523] 2 exiting: rc = 0 00000100:00100000:2.0:1788658544.502456:0:9539:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a1d8262b400:9539] 3 exiting: rc = 0 00000100:00100000:2.0:1788658544.502543:0:6522:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a1e82eac000:6522] 1 exiting: rc = 0 00000100:00100000:1.0:1788658544.502954:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.502963:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.502970:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.502976:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.502982:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.502988:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.502995:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503001:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503008:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503014:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503020:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503028:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503033:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503039:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503046:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503053:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503059:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503065:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503072:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503078:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503085:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503091:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503097:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503103:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503109:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503115:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503121:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503127:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503132:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503157:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503163:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503169:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503175:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503180:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503185:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503190:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503195:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503201:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503206:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503211:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503216:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503221:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503226:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503231:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503235:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503241:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503247:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503253:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503258:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503264:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503271:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503277:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503282:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503287:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503292:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503297:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503303:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503309:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503315:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503321:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503325:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503331:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503336:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.503341:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788658544.504501:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658544.504516:0:15776:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788658544.504525:0:15776:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1d8230c000 1 00000020:00000080:1.0:1788658544.504534:0:15776:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x48e67cc629c6e742 00000020:00000080:1.0:1788658544.504545:0:15776:0:(genops.c:885:class_export_put()) final put ffff8a1d82606000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788658544.504617:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8a1ebdc08000 for lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788658544.504626:0:37:0:(genops.c:885:class_export_put()) final put ffff8a1ebdc0c800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788658544.504630:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebdc0c800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788658544.504639:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000000:1.0:1788658544.505022:0:15776:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788658544.505029:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658544.505036:0:15776:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788658544.505042:0:15776:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8a1d821bb380) has no exports 00000020:00000080:3.0:1788658544.505939:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d82606000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788658544.537581:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658544.537611:0:15776:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788658544.537618:0:15776:0:(genops.c:885:class_export_put()) final put ffff8a1d8230e000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788658544.537623:0:15776:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1d8230e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788658544.537637:0:15776:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788658544.538229:0:15776:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a1d8230b000 00000020:01000000:0.0:1788658544.538256:0:15776:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788658544.538261:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658544.538268:0:15776:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788658544.538273:0:15776:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8a1eb23f0000) has no exports 00000020:00000080:0.0:1788658544.538299:0:15776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658544.538304:0:15776:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788658544.538307:0:15776:0:(genops.c:885:class_export_put()) final put ffff8a1ebd939000/OSS_uuid 00000020:00000080:0.0:1788658544.538310:0:15776:0:(genops.c:844:class_export_destroy()) destroying export ffff8a1ebd939000/OSS_uuid for OSS 00000020:01000000:0.0:1788658544.538318:0:15776:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788658544.538433:0:6532:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788658544.538879:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8a1ebd96f800:8452] 0 exiting: rc = 1 00000100:00100000:3.0:1788658544.539030:0:8454:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8a1e8318e200:8454] 2 exiting: rc = 0 00000100:00100000:0.0:1788658544.539148:0:8453:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8a1eb2164600:8453] 1 exiting: rc = 0 00000100:00100000:0.0:1788658544.539228:0:13833:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8a1ea1859e00:13833] 4 exiting: rc = 0 00000100:00100000:1.0:1788658544.539406:0:10365:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8a1d832e0800:10365] 3 exiting: rc = 0 00000100:00100000:0.0:1788658544.539582:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539592:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539604:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539612:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539619:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539625:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539631:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539637:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539922:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539930:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539935:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539941:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539946:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539951:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539957:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539963:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539968:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539974:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.539997:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540002:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540008:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540014:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540020:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540026:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540032:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540038:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540043:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540048:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540054:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540059:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540065:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540070:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540076:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540082:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540087:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540093:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540100:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540105:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540111:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540116:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540123:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540129:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540136:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540142:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540148:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540154:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540160:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540165:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540170:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540176:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540182:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540188:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540194:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540207:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540213:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540219:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540225:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540230:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540235:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540241:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540246:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540251:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540256:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.540267:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.541348:0:8455:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a1e8f29f200:8455] 0 exiting: rc = 1 00000100:00100000:2.0:1788658544.541541:0:14839:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8a1d83e11400:14839] 2 exiting: rc = 0 00000100:00100000:3.0:1788658544.541954:0:8456:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a1eb332ea00:8456] 1 exiting: rc = 0 00000100:00100000:0.0:1788658544.542070:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542085:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542095:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542101:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542107:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542114:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542120:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542126:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542132:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542139:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542145:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542150:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542156:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542162:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542168:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542174:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542180:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542186:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542192:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542198:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542205:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542211:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542217:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542239:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542245:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542272:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542279:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542285:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542291:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542298:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542304:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542310:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542317:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542323:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542329:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542336:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542343:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542349:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542354:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542372:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542379:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542385:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542390:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542396:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542402:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542408:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542414:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542419:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542425:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542431:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542437:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542442:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542448:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542455:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542461:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542467:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542473:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542479:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542493:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542498:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542509:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542516:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542522:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658544.542526:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.544480:0:8457:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a1eb35c4c00:8457] 0 exiting: rc = 1 00000100:00100000:2.0:1788658544.544950:0:8459:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a1eb35c4200:8459] 2 exiting: rc = 0 00000100:00100000:2.0:1788658544.545139:0:8458:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a1eb35c3a00:8458] 1 exiting: rc = 0 00000100:00100000:3.0:1788658544.545239:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545248:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545255:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545260:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545266:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545271:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545278:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545286:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545292:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545298:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545304:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545310:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545317:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545342:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545350:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545368:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545376:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545381:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545387:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545394:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545401:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545408:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545416:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545423:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545430:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545436:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545443:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545449:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545456:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545463:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545470:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545492:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545500:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545506:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545512:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545518:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545525:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545531:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545537:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545544:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545551:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545557:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545563:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545570:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545576:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545582:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545589:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545596:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545610:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545617:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545623:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545630:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545637:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545657:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545664:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545671:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545688:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545696:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545734:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545859:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545870:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545878:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545885:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.545892:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.552539:0:8461:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a1eb35c2c00:8461] 1 exiting: rc = 0 00000100:00100000:1.0:1788658544.552863:0:8460:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a1eb35c2400:8460] 0 exiting: rc = 1 00000100:00100000:2.0:1788658544.553450:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553461:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553468:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553473:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553480:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553500:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553506:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553512:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553518:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553524:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553530:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553535:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553541:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553546:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553552:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553557:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553563:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553568:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553573:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553578:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553584:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553589:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553595:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553600:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553610:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553616:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553622:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553627:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553633:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553652:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553659:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553665:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553671:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553676:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553682:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553688:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553695:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553722:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553729:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553735:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553891:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553897:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553903:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553914:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553921:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553926:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553932:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553938:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553944:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553950:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553957:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553962:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553968:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553974:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553980:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553986:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553992:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.553998:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.554004:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.554009:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.554015:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.554020:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.554027:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658544.554038:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658544.555628:0:8462:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a1eb3334400:8462] 0 exiting: rc = 1 00000100:00100000:0.0:1788658544.556096:0:8463:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a1eb3335400:8463] 1 exiting: rc = 0 00000100:00100000:3.0:1788658544.556204:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556225:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556258:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556266:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556274:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556281:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556289:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556297:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556305:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556312:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556320:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556326:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556334:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556341:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556377:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556387:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556395:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556402:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556428:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556435:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556442:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556450:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556457:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556464:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556471:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556477:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556499:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556507:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556514:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556521:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556528:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556534:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556540:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556547:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556554:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556560:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556567:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556574:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556597:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556604:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556611:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556618:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556625:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556631:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556637:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556654:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556661:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556667:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556674:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556681:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556732:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556859:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556869:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556885:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556893:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556900:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556907:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556914:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556922:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556929:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556936:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556943:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556949:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658544.556963:0:15776:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788658544.569660:0:15776:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788658564.162187:0:16541:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788658577.321927:0:17141:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788658577.321933:0:17141:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788658577.321935:0:17141:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788658577.322058:0:17141:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1eb751f000 00000020:01000004:3.0:1788658577.322075:0:17141:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788658577.322082:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788658577.322096:0:17141:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a1d821bcd40) 00000020:00000080:3.0:1788658577.322109:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788658577.398639:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788658577.422588:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788658577.425238:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788658577.428506:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788658577.429469:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788658577.430150:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788658577.434581:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788658577.435388:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788658577.435673:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788658577.435923:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788658577.436160:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788658577.436398:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788658577.436649:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788658577.436898:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788658577.437387:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.437635:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.437879:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.438103:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.438342:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.438582:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.438810:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.439031:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.439217:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.439419:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.439624:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.446523:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.447577:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.447903:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.448167:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.448464:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.448726:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.448967:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.449205:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.449460:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.449734:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.449986:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.450231:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.450492:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.450845:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.451061:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.451262:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.451478:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.451677:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.452006:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.452339:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788658577.452535:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788658577.457646:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788658577.460113:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788658577.460512:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788658577.463663:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788658577.466861:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788658577.467642:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788658577.467883:0:17141:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1788658577.469447:0:17141:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788658577.470906:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788658577.470916:0:17141:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788658577.470930:0:17141:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6f986 00000020:01000004:1.0:1788658577.470937:0:17141:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788658577.470942:0:17141:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788658577.470948:0:17141:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1eb751f000 from MGS 00000020:01000004:1.0:1788658577.470952:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788658577.470964:0:17141:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a1d827799c0) 00000020:00000080:1.0:1788658577.470975:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788658577.471035:0:17141:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1eb751f000 from MGS, refs=2 00080000:01000000:1.0:1788658577.471040:0:17141:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788658577.471045:0:17141:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6f994 00000100:00100000:1.0:1788658577.471157:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788658577.471342:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788658577.471354:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788658577.472457:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788658577.472465:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788658577.473229:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658577.473394:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788658577.473399:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788658577.474332:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788658577.474340:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788658577.474956:0:17141:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788658577.474963:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788658577.475533:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658577.475536:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658577.475538:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658577.476265:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658577.476269:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658577.476271:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658577.477184:0:17141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788658577.480439:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788658577.481398:0:17141:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788658577.482186:0:17153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788658577.482229:0:17141:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788658577.482265:0:17141:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788658577.482860:0:17141:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788658577.483166:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658577.483329:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788658577.483335:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788658577.489979:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788658577.489995:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788658577.490309:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788658577.490316:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788658577.496368:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788658577.496406:0:17141:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.153@tcp' 00000020:01000004:0.0:1788658577.496408:0:17141:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788658577.496436:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.153@tcp (typ=mgc) 00000020:00000080:0.0:1788658577.496450:0:17141:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.153@tcp (ffff8a1eb23f0000) 00000020:00000080:0.0:1788658577.496466:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788658577.496540:0:17141:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d83d58800@MGC192.168.202.153@tcp: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1788658577.497210:0:17141:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.153@tcp-0 is initialized 00000040:01000000:0.0:1788658577.497230:0:17141:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788658577.499491:0:17159:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788658577.499539:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.153@tcp (uuid 913293d7-fe00-4834-a4c1-1b0cae17d59a) 00000020:00000080:0.0:1788658577.499632:0:17141:0:(genops.c:1385:class_connect()) connect: client 913293d7-fe00-4834-a4c1-1b0cae17d59a, cookie 0x48e67cc629c6f9a2 00000100:00080000:0.0:1788658577.499646:0:17141:0:(import.c:545:import_select_connection()) MGC192.168.202.153@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658577.499653:0:17141:0:(import.c:665:import_select_connection()) MGC192.168.202.153@tcp: import ffff8a1d83d58800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658577.499687:0:17141:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7402d80 x1875544025245696/t0(0) o250->MGC192.168.202.153@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788658577.499734:0:17141:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 913293d7-fe00-4834-a4c1-1b0cae17d59a->MGS 00000020:01000004:0.0:1788658577.499760:0:17141:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788658577.499766:0:17141:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788658577.499780:0:17141:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a1eb23f19c0) 00000020:00000080:0.0:1788658577.499793:0:17141:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788658577.502685:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:913293d7-fe00-4834-a4c1-1b0cae17d59a:3646:1875544025245696:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788658577.502781:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658577.504729:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025245696 00000100:00100000:1.0:1788658577.504743:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025245696 00000100:00100000:1.0:1788658577.504783:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658577.504791:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875544025245696:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788658577.504820:0:17154:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 913293d7-fe00-4834-a4c1-1b0cae17d59a@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:1.0:1788658577.504851:0:17154:0:(genops.c:1385:class_connect()) connect: client 913293d7-fe00-4834-a4c1-1b0cae17d59a, cookie 0x48e67cc629c6f9b0 00000100:00080000:1.0:1788658577.505360:0:17154:0:(import.c:65:import_set_state_nolock()) ffff8a1eb740f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658577.505457:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+5:3646:x1875544025245696:12345-0@lo:250:mount.lustre.0 Request processed in 665us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658577.505464:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658577.505542:0:3646:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.153@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788658577.505552:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.153@tcp: connect to target with instance 0 00000100:00080000:2.0:1788658577.505769:0:17158:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00080000:1.0:1788658577.506437:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.153@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788658577.506445:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788658577.506448:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d83d58800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788658577.506451:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788658577.506455:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788658577.506461:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:913293d7-fe00-4834-a4c1-1b0cae17d59a:3646:1875544025245696:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788658577.518210:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658577.518400:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788658577.518405:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788658577.525445:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788658577.525456:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788658577.526118:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788658577.526126:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788658577.527038:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658577.527203:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788658577.527210:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788658577.527694:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788658577.528226:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788658577.566435:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658577.567947:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788658577.567956:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788658577.576876:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788658577.576894:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788658577.577406:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658577.578689:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788658577.578699:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788658577.579155:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788658577.579160:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788658577.579671:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658577.579876:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788658577.579881:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788658577.586456:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788658577.588696:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788658577.589427:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658577.589872:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788658577.589879:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788658577.594749:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788658577.594764:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788658577.685555:0:17141:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658577.686673:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788658577.686682:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788658577.694488:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788658577.694506:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788658577.695450:0:17141:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788658577.695460:0:17141:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788658577.706410:0:17141:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788658577.706455:0:17141:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788658577.706461:0:17141:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788658577.706682:0:17141:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788658577.706970:0:17141:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788658577.706975:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788658577.706976:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658577.706977:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658577.706978:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658577.706979:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658577.706980:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658577.706982:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658577.706983:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658577.706985:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658577.706986:0:17141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658577.706989:0:17141:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788658577.706991:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658577.706992:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658577.706993:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658577.706999:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658577.707000:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658577.707001:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658577.707002:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658577.707003:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658577.707004:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658577.707005:0:17141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658577.707045:0:17141:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788658577.707065:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025245824:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788658577.707137:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658577.707244:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83485480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658577.710676:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025245824 00000100:00100000:2.0:1788658577.710693:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025245824 00000100:00100000:2.0:1788658577.716434:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658577.716449:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+5:17141:x1875544025245824:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788658577.716517:0:17157:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788658577.716521:0:17157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788658577.716524:0:17157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788658577.716949:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788658577.717455:0:17157:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788658577.718993:0:17179:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788658577.718999:0:17179:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788658577.719002:0:17179:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788658577.719004:0:17179:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788658577.719207:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788658577.719478:0:17157:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788658577.719488:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788658577.722197:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+5:17141:x1875544025245824:12345-0@lo:253:mount.lustre.0 Request processed in 5741us (15050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658577.722212:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658577.722413:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025245824:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788658577.722429:0:17141:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788658577.722432:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788658577.722434:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788658577.722436:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658577.722437:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658577.722439:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658577.722440:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658577.722441:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658577.722442:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788658577.722444:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658577.722445:0:17141:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788658577.722467:0:17141:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1eb751f000 from lustre-MDT0000 10000000:01000000:0.0:1788658577.722499:0:17141:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788658577.722502:0:17141:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788658577.722507:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a1eb23f0000 10000000:01000000:0.0:1788658577.722511:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658577.722519:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a1eb23f0000 from 1 10000000:01000000:0.0:1788658577.722522:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788658577.722560:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.722581:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.722606:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658577.722626:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025245952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658577.722664:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658577.723424:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83485240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658577.723559:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025245952 00000100:00100000:2.0:1788658577.723577:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025245952 00000100:00100000:2.0:1788658577.723626:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658577.723637:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+5:17141:x1875544025245952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658577.723651:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658577.723671:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a0c00/0x48e67cc629c6f9be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6f9b7 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658577.723696:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a0c00/0x48e67cc629c6f9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6f9b7 expref: 6 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658577.723723:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a0c00/0x48e67cc629c6f9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6f9b7 expref: 6 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658577.723747:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0c00, rc 0) 00000100:00100000:2.0:1788658577.723799:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+6:17141:x1875544025245952:12345-0@lo:101:mount.lustre.0 Request processed in 164us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658577.723806:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658577.724008:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025245952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658577.724025:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.724035:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658577.724098:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025246080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658577.724129:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658577.724162:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82bef480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658577.724223:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025246080 00000100:00100000:0.0:1788658577.724228:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025246080 00000100:00100000:0.0:1788658577.724272:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658577.724279:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+6:17141:x1875544025246080:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658577.724389:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+6:17141:x1875544025246080:12345-0@lo:501:mount.lustre.0 Request processed in 110us (259us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788658577.724396:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658577.724480:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025246080:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788658577.724512:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788658577.724531:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.724549:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658577.724558:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1eb751f000 10000000:01000000:1.0:1788658577.724563:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788658577.724579:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a1eb751f000 10000000:01000000:1.0:1788658577.724582:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788658577.724585:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a1eb751f000 from 1 10000000:01000000:1.0:1788658577.724588:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788658577.724608:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.724616:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.724624:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658577.724636:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025246208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788658577.724662:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658577.724674:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82bef480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658577.724855:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025246208 00000100:00100000:0.0:1788658577.724859:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025246208 00000100:00100000:0.0:1788658577.724892:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658577.724899:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+6:17141:x1875544025246208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658577.724907:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658577.724920:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81671800/0x48e67cc629c6f9cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6f9c5 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.724935:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81671800/0x48e67cc629c6f9cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6f9c5 expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.724945:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81671800/0x48e67cc629c6f9cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6f9c5 expref: 7 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.724964:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671800, rc 0) 00000100:00100000:0.0:1788658577.724994:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+7:17141:x1875544025246208:12345-0@lo:101:mount.lustre.0 Request processed in 96us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658577.725001:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658577.728778:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025246208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658577.728811:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.728824:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658577.728866:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788658577.728879:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.728887:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d83419a00/0x48e67cc629c6f9c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9cc expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658577.728895:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788658577.728915:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788658577.728921:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a1eb751f000 10000000:01000000:1.0:1788658577.728924:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788658577.728929:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788658577.728932:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788658577.728963:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.728970:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.728979:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658577.728999:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025246336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788658577.729055:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658577.729087:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82bef480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658577.729294:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025246336 00000100:00100000:0.0:1788658577.729301:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025246336 00000100:00100000:0.0:1788658577.729354:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658577.729365:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+7:17141:x1875544025246336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658577.729376:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658577.729389:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81671a00/0x48e67cc629c6f9da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6f9d3 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.729411:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81671a00/0x48e67cc629c6f9da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6f9d3 expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.729421:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81671a00/0x48e67cc629c6f9da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6f9d3 expref: 8 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.729429:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671a00, rc 0) 00000100:00100000:0.0:1788658577.729467:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+8:17141:x1875544025246336:12345-0@lo:101:mount.lustre.0 Request processed in 105us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658577.729474:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658577.729782:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025246336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658577.729793:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.729809:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658577.729863:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025246464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658577.729891:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658577.729921:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82bef480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658577.729975:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025246464 00000100:00100000:2.0:1788658577.729980:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025246464 00000100:00100000:2.0:1788658577.730007:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658577.730014:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+8:17141:x1875544025246464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658577.730162:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+9:17141:x1875544025246464:12345-0@lo:501:mount.lustre.0 Request processed in 148us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658577.730169:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658577.730251:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025246464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658577.730308:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025246592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658577.730346:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658577.730369:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82bef480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658577.730422:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025246592 00000100:00100000:2.0:1788658577.730426:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025246592 00000100:00100000:2.0:1788658577.730451:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658577.730457:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+9:17141:x1875544025246592:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658577.731405:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+9:17141:x1875544025246592:12345-0@lo:503:mount.lustre.0 Request processed in 944us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658577.731415:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658577.731509:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025246592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658577.731986:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17180:1875544025246720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658577.732023:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658577.732054:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82bef240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658577.732106:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025246720 00000100:00100000:2.0:1788658577.732111:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025246720 00000100:00100000:2.0:1788658577.732149:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658577.732158:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+9:17180:x1875544025246720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658577.732786:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+9:17180:x1875544025246720:12345-0@lo:502:llog_process_th.0 Request processed in 628us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658577.732794:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658577.732916:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17180:1875544025246720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658577.732943:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658577.732954:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658577.732956:0:17180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788658577.732961:0:17180:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788658577.732964:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658577.732978:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a1d8277cd40) 00000020:00000080:1.0:1788658577.732994:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788658577.732999:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788658577.733079:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788658577.733089:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6f9e8 00000020:00000080:1.0:1788658577.733318:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788658577.733322:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658577.733326:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658577.733327:0:17180:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788658577.733329:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658577.733333:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658577.733334:0:17180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788658577.733337:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658577.733343:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a1d82778000) 00000020:00000080:1.0:1788658577.733351:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788658577.733354:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788658577.733356:0:17180:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788658577.733359:0:17180:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788658577.733364:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788658577.733401:0:17180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1eb751f000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788658577.733412:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a1d8277b380) 00000020:00000080:1.0:1788658577.733419:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788658577.733462:0:17180:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788658577.733467:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6f9fd 00000020:00000080:1.0:1788658577.733554:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788658577.733559:0:17180:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788658577.733563:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x48e67cc629c6fa04 00080000:01000000:1.0:1788658577.733567:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788658577.733692:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6fa0b 00010000:00010000:2.0:1788658577.878554:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788658577.879337:0:17180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1788658577.879695:0:17180:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788658577.880338:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a1ebd884d40) 00000020:00000080:2.0:1788658577.880360:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788658577.880447:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788658577.880455:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6fa19 00000020:00000080:3.0:1788658577.881307:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788658577.887669:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x48e67cc629c6fa20 00000020:00000080:3.0:1788658577.897196:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788658577.897212:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658577.897355:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658577.897359:0:17180:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788658577.897364:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788658577.897366:0:17180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788658577.897368:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788658577.897370:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788658577.897371:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788658577.897374:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658577.897375:0:17180:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788658577.897378:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658577.897391:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658577.897393:0:17180:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788658577.897399:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788658577.897462:0:17180:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788658577.897480:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658577.897483:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658577.897485:0:17180:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788658577.897487:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658577.897490:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658577.897491:0:17180:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788658577.897493:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788658577.897499:0:17180:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:00000080:1.0:1788658577.897525:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658577.897556:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8a1ebf43b380) 00000020:00000080:1.0:1788658577.897578:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788658577.897584:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788658577.897639:0:17180:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788658577.897645:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788658577.897654:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6fa2e 00010000:00080000:1.0:1788658577.897685:0:17180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb213e800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1788658577.899686:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788658577.925077:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788658577.925095:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788658577.925145:0:17180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788658577.925166:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6fa35 00000100:00080000:0.0:1788658577.925177:0:17180:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658577.925190:0:17180:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a1eb213e800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658577.925227:0:17180:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7400e00 x1875544025246848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658577.925910:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025246848:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658577.925987:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788658577.926054:0:17180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788658577.926132:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658577.926137:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658577.926139:0:17180:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788658577.926142:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788658577.926144:0:17180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1788658577.926146:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788658577.926148:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788658577.926149:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788658577.926152:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658577.926153:0:17180:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788658577.926155:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788658577.926160:0:17180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788658577.926163:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658577.926164:0:17180:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788658577.926167:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788658577.926172:0:17180:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:0.0:1788658577.926192:0:17180:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788658577.926194:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788658577.926207:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a1eb23f3380) 00000020:00000080:0.0:1788658577.926219:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788658577.926223:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788658577.926376:0:17180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788658577.926384:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788658577.926390:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6fa43 00010000:00080000:0.0:1788658577.926420:0:17180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb3234000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1788658577.926628:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788658577.928322:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658577.928344:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025246976:0@lo:400:kworker.0 00000100:00100000:0.0:1788658577.928396:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658577.929173:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025246976 00000100:00100000:2.0:1788658577.929183:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025246976 00000100:00100000:2.0:1788658577.929235:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658577.929253:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+9:3647:x1875544025246976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658577.929352:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+9:3647:x1875544025246976:12345-0@lo:400:kworker.0 Request processed in 101us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658577.929360:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788658577.929779:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025246976:0@lo:400:kworker.0 00000040:01000000:0.0:1788658577.931763:0:17180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788658577.932951:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025246848 00000100:00100000:3.0:1788658577.932965:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025246848 00000100:00100000:3.0:1788658577.933010:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658577.933018:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025246848:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788658577.933039:0:17167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1788658577.945849:0:17180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788658577.958516:0:17180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658577.959892:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00100000:3.0:1788658577.970069:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025246848:12345-0@lo:38:llog_process_th.0 Request processed in 37043us (44074us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788658577.970084:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788658577.970150:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658577.970156:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788658577.970160:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025246848:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788658577.971231:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788658577.972023:0:17186:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788658577.972029:0:17186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788658577.973081:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788658577.973094:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788658577.973133:0:17180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788658577.973155:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6fa4a 00000100:00080000:3.0:1788658577.973165:0:17180:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658577.973171:0:17180:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1eb3234000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658577.973207:0:17180:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb98000 x1875544025247104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658577.973341:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025247104:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788658577.973397:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025247104 offset 0 length 520: 4 00000100:00080000:3.0:1788658577.973553:0:17180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788658577.973621:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658577.973625:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658577.973628:0:17180:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788658577.973630:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788658577.973639:0:17180:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788658577.973641:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658577.973643:0:17180:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658577.973644:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788658577.973647:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658577.973648:0:17180:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788658577.973651:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788658577.973655:0:17180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788658577.973659:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658577.973660:0:17180:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788658577.973663:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788658577.973667:0:17180:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:3.0:1788658577.973688:0:17180:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788658577.973691:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658577.973724:0:17180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a1d821b99c0) 00000020:00000080:3.0:1788658577.973738:0:17180:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788658577.973744:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788658577.973827:0:17180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788658577.973833:0:17180:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788658577.973838:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x48e67cc629c6fa58 00010000:00080000:3.0:1788658577.973865:0:17180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb3235800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658577.974066:0:17180:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788658577.974130:0:17180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788658577.974145:0:17180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788658577.976189:0:17180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658577.976464:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788658577.976684:0:17180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788658577.977223:0:17188:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788658577.977230:0:17188:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788658577.980188:0:17180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788658577.980200:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788658577.980239:0:17180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788658577.980475:0:17180:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6fa5f 00000100:00080000:3.0:1788658577.980486:0:17180:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658577.980503:0:17180:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1eb3235800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658577.980540:0:17180:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb99880 x1875544025247232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658577.980568:0:17180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788658577.980676:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025247232:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788658577.980763:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025247232 offset 0 length 520: 4 00000020:01000000:3.0:1788658577.980979:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658577.980984:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658577.980986:0:17180:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788658577.980989:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658577.980993:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658577.980995:0:17180:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788658577.980998:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788658577.981000:0:17180:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788658577.981002:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658577.981004:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658577.981006:0:17180:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788658577.981008:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658577.981010:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658577.981012:0:17180:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788658577.981015:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788658577.981044:0:17180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17180:1875544025247360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658577.981223:0:17180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658577.981354:0:17180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1264cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658577.981407:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025247360 00000100:00100000:0.0:1788658577.981415:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025247360 00000100:00100000:0.0:1788658577.981465:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788658577.981474:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+9:17180:x1875544025247360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658577.981599:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+9:17180:x1875544025247360:12345-0@lo:502:llog_process_th.0 Request processed in 125us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658577.981607:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658577.981962:0:17180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17180:1875544025247360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788658577.981988:0:17180:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658577.981993:0:17180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658577.981996:0:17180:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788658577.982000:0:17180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788658577.982319:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788658577.982342:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788658577.982397:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.982409:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d83418600/0x48e67cc629c6f9d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9da expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658577.982417:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1eb751f000 from 1 10000000:01000000:0.0:1788658577.982420:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788658577.982447:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.982455:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.982476:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658577.982491:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025247488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658577.982524:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658577.982548:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e989a9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658577.982890:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025247488 00000100:00100000:1.0:1788658577.982897:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025247488 00000100:00100000:1.0:1788658577.982969:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658577.982978:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+9:17141:x1875544025247488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658577.982991:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658577.983007:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fa6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fa66 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.983029:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fa6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fa66 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.983040:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fa6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fa66 expref: 10 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658577.983049:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418800, rc 0) 00000100:00100000:1.0:1788658577.983100:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+10:17141:x1875544025247488:12345-0@lo:101:mount.lustre.0 Request processed in 123us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658577.983106:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658577.983177:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025247488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658577.983189:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658577.983198:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658577.983798:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025247616:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788658577.984092:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658577.987528:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebdbd4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658577.987696:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025247616 00000100:00100000:0.0:1788658577.987727:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025247616 00000100:00100000:0.0:1788658577.987778:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658577.987787:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+10:17141:x1875544025247616:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788658577.987821:0:17157:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788658577.987827:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788658577.987917:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+10:17141:x1875544025247616:12345-0@lo:256:mount.lustre.0 Request processed in 130us (3824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658577.987925:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658577.988353:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025247616:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788658577.988958:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788658577.988986:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658577.988997:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658577.989006:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1eb751f000 from 1 10000000:01000000:2.0:1788658577.989009:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658577.989043:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658577.989051:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658577.989059:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658577.989079:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025247744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658577.989122:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658577.989151:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebdbd4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658577.989428:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025247744 00000100:00100000:0.0:1788658577.989434:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025247744 00000100:00100000:0.0:1788658577.989462:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658577.989469:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+10:17141:x1875544025247744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658577.989480:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658577.989493:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fa7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fa74 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.989515:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fa7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fa74 expref: 11 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.989525:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fa7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fa74 expref: 11 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658577.989540:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670e00, rc 0) 00000100:00100000:0.0:1788658577.989590:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17141:x1875544025247744:12345-0@lo:101:mount.lustre.0 Request processed in 121us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658577.989597:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658577.989782:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025247744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658577.989796:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658577.989816:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658577.989877:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025247872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658577.989902:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658577.989926:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebdbd4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658577.990022:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025247872 00000100:00100000:0.0:1788658577.990027:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025247872 00000100:00100000:0.0:1788658577.990044:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788658577.990049:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17141:x1875544025247872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658577.990179:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17141:x1875544025247872:12345-0@lo:501:mount.lustre.0 Request processed in 129us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658577.990185:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658577.990323:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025247872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658577.990361:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025248000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658577.990393:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658577.990415:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebdbd4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658577.990466:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025248000 00000100:00100000:0.0:1788658577.990470:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025248000 00000100:00100000:0.0:1788658577.990487:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658577.990493:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17141:x1875544025248000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658577.990575:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17141:x1875544025248000:12345-0@lo:503:mount.lustre.0 Request processed in 81us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658577.990591:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658577.990733:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025248000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658577.991379:0:17190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17190:1875544025248128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658577.991416:0:17190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658577.991445:0:17190:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebdbd4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658577.991491:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025248128 00000100:00100000:0.0:1788658577.991495:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025248128 00000100:00100000:0.0:1788658577.991524:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658577.991530:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17190:x1875544025248128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658577.992046:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17190:x1875544025248128:12345-0@lo:502:llog_process_th.0 Request processed in 513us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658577.992054:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788658577.992156:0:17190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17190:1875544025248128:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658577.992183:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658577.992193:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658577.992195:0:17190:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788658577.992202:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1eb751f000 00000020:00000080:2.0:1788658577.992205:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788658577.992214:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658577.992216:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658577.992217:0:17190:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788658577.992220:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658577.992222:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658577.992223:0:17190:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788658577.992227:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1eb751f000 00000020:00000080:2.0:1788658577.992229:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788658577.992363:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658577.992367:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658577.992368:0:17190:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788658577.992370:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658577.992373:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658577.992374:0:17190:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788658577.992383:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1eb751f000 00000020:00000080:2.0:1788658577.992384:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788658577.992402:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658577.992405:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658577.992406:0:17190:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788658577.992408:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658577.992411:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658577.992412:0:17190:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788658577.992415:0:17190:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1eb751f000 00000020:00000080:2.0:1788658577.992417:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788658577.992448:0:17190:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17190:1875544025248256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658577.992482:0:17190:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658577.992502:0:17190:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebdbd4240 going to sleep for 11 seconds 00000100:00100000:1.0:1788658577.992560:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025248256 00000100:00100000:1.0:1788658577.992565:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025248256 00000100:00100000:1.0:1788658577.992655:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658577.992664:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17190:x1875544025248256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658577.992774:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17190:x1875544025248256:12345-0@lo:502:llog_process_th.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658577.992782:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658577.992943:0:17190:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17190:1875544025248256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788658577.992963:0:17190:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658577.992968:0:17190:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658577.992970:0:17190:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788658577.992974:0:17190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788658578.000572:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788658578.000626:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658578.000651:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658578.000664:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658578.004943:0:17141:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788658578.004951:0:17141:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1eb751f000 10000000:01000000:3.0:1788658578.004955:0:17141:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1eb751f000 10000000:01000000:3.0:1788658578.004965:0:17141:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658578.004972:0:17141:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1eb751f000 from 1 10000000:01000000:3.0:1788658578.004976:0:17141:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788658578.005021:0:17141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.005033:0:17141:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.005044:0:17141:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658578.005068:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025248384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658578.005139:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658578.011691:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83158a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658578.014175:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025248384 00000100:00100000:1.0:1788658578.014191:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025248384 00000100:00100000:1.0:1788658578.018969:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658578.018990:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17141:x1875544025248384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658578.019008:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658578.019027:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83418c00/0x48e67cc629c6fa89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fa82 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658578.019058:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83418c00/0x48e67cc629c6fa89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fa82 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658578.019069:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83418c00/0x48e67cc629c6fa89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fa82 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658578.019077:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418c00, rc 0) 00000100:00100000:1.0:1788658578.019162:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17141:x1875544025248384:12345-0@lo:101:mount.lustre.0 Request processed in 180us (14022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658578.019169:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788658578.019358:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025248384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658578.019377:0:17141:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658578.019387:0:17141:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658578.019466:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025248512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658578.019499:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658578.019532:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e989a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658578.019574:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025248512 00000100:00100000:1.0:1788658578.019646:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025248512 00000100:00100000:1.0:1788658578.019685:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658578.019692:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17141:x1875544025248512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658578.019830:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17141:x1875544025248512:12345-0@lo:501:mount.lustre.0 Request processed in 138us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658578.019845:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788658578.021430:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025248512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658578.021484:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025248640:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658578.021545:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658578.021565:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e989a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658578.022376:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025248640 00000100:00100000:1.0:1788658578.022385:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025248640 00000100:00100000:1.0:1788658578.022434:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658578.022444:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17141:x1875544025248640:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658578.022574:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17141:x1875544025248640:12345-0@lo:503:mount.lustre.0 Request processed in 131us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658578.022598:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658578.024727:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025248640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658578.026786:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17195:1875544025248768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658578.027279:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658578.027334:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83158480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658578.027488:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025248768 00000100:00100000:1.0:1788658578.027496:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025248768 00000100:00100000:1.0:1788658578.027550:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658578.027560:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17195:x1875544025248768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788658578.031563:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17195:x1875544025248768:12345-0@lo:502:llog_process_th.0 Request processed in 3995us (4274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658578.031577:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658578.032346:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17195:1875544025248768:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788658578.032425:0:17195:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788658578.032440:0:17195:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a1d821bb380) 00000020:00000080:3.0:1788658578.032460:0:17195:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788658578.032549:0:17195:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1eb751f000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788658578.032554:0:17195:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1eb751f000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788658578.032556:0:17195:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1eb751f000 4 00010000:00080000:3.0:1788658578.032598:0:17195:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb3230800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658578.038048:0:17195:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788658578.038808:0:17195:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788658578.038852:0:17195:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788658578.038871:0:17195:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x48e67cc629c6fa97 00000100:00080000:3.0:1788658578.038882:0:17195:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658578.038889:0:17195:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a1eb3230800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658578.038924:0:17195:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb9b800 x1875544025248896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658578.038949:0:17195:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788658578.039369:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17195:1875544025249024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658578.039521:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658578.039557:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025249024 00000100:00100000:3.0:1788658578.039563:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025249024 00000100:00100000:3.0:1788658578.039677:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658578.039687:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17195:x1875544025249024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658578.039815:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17195:x1875544025249024:12345-0@lo:502:llog_process_th.0 Request processed in 129us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658578.039823:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658578.039871:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83158540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658578.039893:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17195:1875544025249024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658578.039938:0:17195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17195:1875544025249152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658578.039971:0:17195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658578.039993:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025249152 00000100:00100000:3.0:1788658578.039997:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025249152 00000100:00100000:3.0:1788658578.040018:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658578.040024:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17195:x1875544025249152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658578.040084:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17195:x1875544025249152:12345-0@lo:502:llog_process_th.0 Request processed in 58us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658578.040100:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658578.040126:0:17195:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83158540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658578.040137:0:17195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:913293d7-fe00-4834-a4c1-1b0cae17d59a:17195:1875544025249152:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788658578.040156:0:17195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:1.0:1788658578.040828:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025248896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658578.040872:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658578.040960:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025248896 00000100:00100000:3.0:1788658578.040964:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025248896 00000100:00100000:3.0:1788658578.040994:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658578.041000:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875544025248896:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788658578.041049:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875544025248896:12345-0@lo:38:llog_process_th.0 Request processed in 47us (176us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788658578.041055:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658578.041083:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788658578.041090:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3230800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658578.041094:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788658578.041097:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025248896:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788658578.042374:0:17141:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788658578.042408:0:17141:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788658578.042675:0:17141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658578.042688:0:17141:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97e00/0x48e67cc629c6fa82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fa89 expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788658578.042782:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788658578.042790:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658578.042791:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658578.042792:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658578.042793:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658578.042794:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658578.042796:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658578.042797:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658578.042799:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658578.042800:0:17141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658578.042805:0:17141:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788658578.042808:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658578.042809:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658578.042810:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658578.042811:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658578.042812:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658578.042813:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658578.042814:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658578.042815:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658578.042816:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658578.042817:0:17141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658578.042850:0:17141:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788658578.042875:0:17141:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025249280:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658578.042967:0:17141:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658578.043013:0:17141:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebdbd4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788658578.043100:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025249280 00000100:00100000:3.0:1788658578.043110:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025249280 00000100:00100000:3.0:1788658578.043173:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658578.043183:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17141:x1875544025249280:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788658578.043223:0:17154:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788658578.043261:0:17154:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788658578.051032:0:17154:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788658578.051053:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788658578.051155:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788658578.051160:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788658578.051186:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.051218:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fa6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fa66 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.051227:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.052820:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fa6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fa66 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.052839:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fa6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fa66 expref: 12 pid: 17154 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658578.052855:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025249408:0@lo:104: 00000100:00100000:3.0:1788658578.052919:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658578.052961:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83158540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658578.053018:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17141:x1875544025249280:12345-0@lo:253:mount.lustre.0 Request processed in 9836us (10051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658578.053029:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788658578.053396:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025249408 00000100:00100000:2.0:1788658578.053404:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025249408 00000100:00100000:2.0:1788658578.053644:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658578.053654:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:17178:x1875544025249408:12345-0@lo:104: 00010000:00010000:2.0:1788658578.053671:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658578.053748:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658578.053754:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:17178:x1875544025249408:12345-0@lo:104: Request processed in 102us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658578.053761:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658578.053808:0:17141:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17141:1875544025249280:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788658578.053821:0:17141:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788658578.053824:0:17141:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658578.053825:0:17141:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658578.053827:0:17141:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658578.053828:0:17141:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658578.053829:0:17141:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658578.053830:0:17141:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658578.053831:0:17141:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658578.053833:0:17141:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658578.053834:0:17141:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658578.053836:0:17141:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788658578.053849:0:17141:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788658578.054402:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025249408:0@lo:104: 00010000:00010000:3.0:1788658578.054545:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.054568:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658578.054573:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.054580:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:3.0:1788658578.054584:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.054602:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658578.054610:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658578.054616:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788658578.054687:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.054694:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658578.054730:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.054737:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e81670a00/0x48e67cc629c6fa66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fa6d expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.054766:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658578.054769:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658578.054770:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658578.054802:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025249536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658578.054841:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658578.054909:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025249536 00000100:00100000:3.0:1788658578.054914:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025249536 00010000:00010000:3.0:1788658578.054932:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fa6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fa66 expref: 12 pid: 17154 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658578.054954:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658578.054961:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:3649:x1875544025249536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658578.054981:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658578.054986:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fa6d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fa66 expref: 12 pid: 17154 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.054996:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fa6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fa66 expref: 12 pid: 17154 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055011:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fa6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fa66 expref: 12 pid: 17154 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055023:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055032:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788658578.055047:0:17147:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003888168s 00010000:00010000:3.0:1788658578.055053:0:17147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055059:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055066:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055072:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055077:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658578.055082:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055095:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055108:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055118:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658578.055147:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:3649:x1875544025249536:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658578.055154:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788658578.055174:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055182:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658578.055189:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b97a00/0x48e67cc629c6fa9e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658578.055215:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025249536:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788658578.073767:0:17141:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788658578.074095:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788658578.074247:0:17201:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788658578.074251:0:17201:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788658578.074386:0:17202:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788658578.074497:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:2.0:1788658578.074883:0:17203:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8a1d83c20700 x1875544025249664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658578.074895:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00000040:01000000:3.0:1788658578.075454:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788658578.075505:0:17141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788658578.075986:0:17141:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788658578.075994:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788658578.076029:0:17141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658578.077069:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788658578.077626:0:17141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788658578.077657:0:17141:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788658578.078042:0:17202:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658578.080169:0:17202:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788658578.080259:0:17202:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:3.0:1788658578.085562:0:17141:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1788658578.090187:0:17141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788658578.096276:0:17141:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788658578.096332:0:17141:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa33e4178b988 00100000:10000000:2.0:1788658578.096344:0:17141:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788658578.097434:0:17141:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788658578.097451:0:17141:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788658578.097471:0:17141:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788658578.097492:0:17141:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788658578.099296:0:17141:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658578.099514:0:17141:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788658578.495019:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658579.075492:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788658579.135054:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 10000000:01000000:1.0:1788658579.262802:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788658579.262811:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1eb751f000 from 7 10000000:01000000:1.0:1788658579.262816:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788658579.262863:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658579.262875:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658579.262887:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658579.262924:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025249792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658579.262995:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658579.263057:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e86200300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658579.263109:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025249792 00000100:00100000:2.0:1788658579.263117:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025249792 00000100:00100000:2.0:1788658579.263175:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658579.263185:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+11:17159:x1875544025249792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658579.263198:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658579.263212:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a0200/0x48e67cc629c6faac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6faa5 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658579.263258:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a0200/0x48e67cc629c6faac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6faa5 expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658579.263269:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a0200/0x48e67cc629c6faac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6faa5 expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658579.263279:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a0200, rc 0) 00000100:00100000:2.0:1788658579.263327:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17159:x1875544025249792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658579.263333:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788658579.263591:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025249792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658579.263606:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658579.263615:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658579.263664:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025249920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788658579.263696:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658579.263746:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e86200300 going to sleep for 11 seconds 00000100:00100000:2.0:1788658579.263926:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025249920 00000100:00100000:2.0:1788658579.263932:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025249920 00000100:00100000:2.0:1788658579.263959:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788658579.263966:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17159:x1875544025249920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788658579.263981:0:17154:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788658579.263997:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788658579.264000:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788658579.264083:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17159:x1875544025249920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658579.264090:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658579.264149:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025249920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788658579.264191:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658579.264197:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658579.264204:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658579.518928:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788658580.097356:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788658580.158782:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:3.0:1788658580.543546:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658581.185266:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:0.0:1788658581.567023:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658582.207839:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00000001:02000400:1.0:1788658582.450886:0:17446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788658582.593587:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658583.233463:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00000100:00080000:3.0:1788658583.492834:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788658583.492842:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788658583.492847:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658583.492856:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:3.0:1788658583.492864:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788658583.492873:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a1eb213e800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658583.492903:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb9b480 x1875544025250176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658583.492920:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658583.492923:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658583.492926:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658583.492929:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658583.492931:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788658583.492934:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788658583.492935:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3230800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658583.492940:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a1eb3230800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658583.492950:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb99500 x1875544025250304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658583.493053:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658583.493073:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025250048:0@lo:400:kworker.0 00000100:00100000:1.0:1788658583.493160:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.493229:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025250176:0@lo:38:kworker.0 00000100:00100000:1.0:1788658583.493261:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.493288:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025250304:0@lo:38:kworker.0 00000100:00100000:1.0:1788658583.493312:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658583.493359:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025250176 00000100:00100000:1.0:1788658583.493367:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025250176 00000100:00100000:1.0:1788658583.493398:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658583.493405:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025250176:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788658583.493423:0:17168:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788658583.494978:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025250048 00000100:00100000:3.0:1788658583.494990:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025250048 00000100:00100000:3.0:1788658583.495169:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658583.495180:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:3649:x1875544025250048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658583.495266:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:3649:x1875544025250048:12345-0@lo:400:kworker.0 Request processed in 89us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658583.495274:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658583.501947:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025250304 00000100:00100000:3.0:1788658583.501962:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025250304 00000100:00100000:3.0:1788658583.502003:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658583.502013:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025250304:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788658583.502251:0:17164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:3.0:1788658583.502295:0:17164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x48e67cc629c6fab3 00000004:00100000:3.0:1788658583.502312:0:17164:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788658583.502443:0:17164:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1215000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658583.502550:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875544025250304:12345-0@lo:38:kworker.0 Request processed in 536us (9235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658583.502558:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658583.506459:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025250048:0@lo:400:kworker.0 00010000:00080000:2.0:1788658583.517979:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1ebdb99500 x1875544025250304/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658583.518003:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788658583.518013:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788658583.518018:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788658583.518030:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3230800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658583.518037:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875544025250304:0@lo:38:kworker.0 00000100:00100000:1.0:1788658583.531120:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025250176:12345-0@lo:38:kworker.0 Request processed in 37703us (37847us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788658583.531135:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788658583.531193:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658583.531199:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788658583.531203:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025250176:0@lo:38:kworker.0 00000020:00000004:3.0:1788658583.572317:0:17498:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658583.572570:0:17498:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788658583.615746:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658584.257121:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00000020:00000004:1.0:1788658584.376748:0:17548:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788658584.376906:0:17548:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788658584.639750:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658585.284071:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:3.0:1788658585.663641:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658586.304872:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:3.0:1788658586.688121:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658587.327800:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00000100:00100000:2.0:1788658587.582950:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658577/real 1788658577] req@ffff8a1ebdb99880 x1875544025247232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658587.582999:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1ebdb99880 x1875544025247232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658587.583009:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658577/real 1788658577] req@ffff8a1ebdb98000 x1875544025247104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658587.583019:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1ebdb98000 x1875544025247104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658587.583038:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658587.583069:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788658587.583073:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025247232:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788658587.583079:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3234000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658587.583084:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788658587.583087:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025247104:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788658587.583240:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788658587.583244:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788658587.583247:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658587.583252:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 500 00000100:00080000:1.0:1788658587.583258:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788658587.583265:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a1eb213e800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658587.583289:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f2300 x1875544025250560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658587.583302:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658587.583314:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788658587.583316:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3234000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658587.583319:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1788658587.583322:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788658587.583325:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1eb3234000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658587.583336:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f3480 x1875544025250688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658587.583345:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658587.583348:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788658587.583350:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658587.583353:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:1.0:1788658587.583355:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788658587.583358:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1eb3235800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658587.583366:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f1880 x1875544025250816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658587.583723:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025250432:0@lo:400:kworker.0 00000100:00100000:0.0:1788658587.583808:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658587.583885:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658587.583892:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025250944:0@lo:400:kworker.0 00000100:00100000:0.0:1788658587.583926:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658587.584089:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025250432 00000100:00100000:1.0:1788658587.584099:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025250432 00000100:00100000:1.0:1788658587.584154:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788658587.584164:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:3647:x1875544025250432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658587.584219:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:3647:x1875544025250432:12345-0@lo:400:kworker.0 Request processed in 57us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658587.584238:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788658587.584291:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025250944 00000100:00100000:1.0:1788658587.584294:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025250944 00000100:00100000:1.0:1788658587.584320:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658587.584326:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025250944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658587.584368:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025250944:12345-0@lo:400:kworker.0 Request processed in 43us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658587.584375:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788658587.584410:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1d834f1180 x1875544025250944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658587.584425:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025250944:0@lo:400:kworker.0 00000100:00100000:1.0:1788658587.584434:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025250432:0@lo:400:kworker.0 00000100:00100000:2.0:1788658587.584588:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025250560:0@lo:38:kworker.0 00000100:00100000:2.0:1788658587.584626:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658587.584661:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025250688:0@lo:8:kworker.0 00000400:00000100:2.0:1788658587.584682:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025250688 offset 0 length 520: 4 00000100:00100000:2.0:1788658587.584735:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025250816:0@lo:8:kworker.0 00000400:00000100:2.0:1788658587.584765:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025250816 offset 0 length 520: 4 00000100:00100000:1.0:1788658587.584835:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025250560 00000100:00100000:1.0:1788658587.584840:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025250560 00000100:00100000:1.0:1788658587.584869:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658587.584874:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025250560:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788658587.584891:0:17167:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788658587.605975:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025250560:12345-0@lo:38:kworker.0 Request processed in 21086us (21334us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788658587.606079:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788658587.606327:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658587.606335:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788658587.606339:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025250560:0@lo:38:kworker.0 00010000:00010000:3.0:1788658587.710920:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658588.351792:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:2.0:1788658588.737829:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658589.375889:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:3.0:1788658589.758921:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788658590.342847:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658590.398908:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:2.0:1788658590.783429:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658591.422796:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00000020:01000004:0.0:1788658591.545322:0:17893:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788658591.545327:0:17893:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788658591.545329:0:17893:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788658591.545459:0:17893:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1e82c42000 00000020:01000004:0.0:1788658591.545477:0:17893:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788658591.545488:0:17893:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788658591.545502:0:17893:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8a1eb23f4d40) 00000020:00000080:0.0:1788658591.545518:0:17893:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788658591.617765:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788658591.618203:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788658591.628451:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788658591.629107:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788658591.629696:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788658591.630329:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788658591.630791:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788658591.631406:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788658591.632227:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788658591.632556:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788658591.636981:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788658591.637366:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788658591.637732:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788658591.638064:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788658591.644063:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.644852:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.645190:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.646092:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.646456:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.646890:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.647134:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.647509:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.647946:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.648416:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.649078:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.649920:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.650539:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.651386:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.655104:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.655896:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.656331:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.656536:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.656981:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.658395:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.659769:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.660690:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.661098:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.661454:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.662000:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.662693:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.663130:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.664017:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.664690:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.665508:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788658591.666904:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788658591.667798:0:17893:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00080000:01000000:1.0:1788658591.669017:0:17893:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788658591.669902:0:17893:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788658591.669916:0:17893:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788658591.669932:0:17893:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6fac1 00000020:01000004:1.0:1788658591.669941:0:17893:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788658591.669963:0:17893:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788658591.669967:0:17893:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788658591.669973:0:17893:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788658591.670004:0:17893:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788658591.670009:0:17893:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788658591.691578:0:17893:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788658591.691696:0:17893:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.153@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788658591.694992:0:17893:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788658591.695003:0:17893:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788658591.695006:0:17893:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658591.695008:0:17893:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658591.695009:0:17893:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658591.695013:0:17893:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658591.695015:0:17893:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658591.695017:0:17893:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658591.695018:0:17893:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658591.695026:0:17893:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788658591.695030:0:17893:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658591.695032:0:17893:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788658591.695033:0:17893:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658591.695034:0:17893:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658591.695036:0:17893:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658591.695037:0:17893:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658591.695038:0:17893:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658591.695039:0:17893:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658591.695041:0:17893:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658591.695110:0:17893:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788658591.695137:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788658591.695218:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658591.695287:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e85234000 going to sleep for 11 seconds 00000100:00100000:3.0:1788658591.695905:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025251072 00000100:00100000:3.0:1788658591.695918:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025251072 00000100:00100000:3.0:1788658591.695997:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658591.696007:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17893:x1875544025251072:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788658591.696050:0:17157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788658591.696053:0:17157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788658591.696064:0:17157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788658591.696733:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17893:x1875544025251072:12345-0@lo:253:mount.lustre.0 Request processed in 724us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658591.696743:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788658591.696853:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251072:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788658591.696866:0:17893:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788658591.696878:0:17893:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658591.696880:0:17893:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788658591.696882:0:17893:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658591.696883:0:17893:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658591.696884:0:17893:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658591.696885:0:17893:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658591.696887:0:17893:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658591.696888:0:17893:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658591.696890:0:17893:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788658591.696912:0:17893:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1e82c42000 from lustre-MDT0001 10000000:01000000:2.0:1788658591.696950:0:17893:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788658591.696953:0:17893:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788658591.696962:0:17893:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1eb23f0000 local copy 00010000:00010000:2.0:1788658591.696974:0:17893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658591.697098:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658591.697132:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.697186:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658591.697498:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025251200 00000100:00100000:1.0:1788658591.697507:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025251200 00000100:00100000:1.0:1788658591.697558:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658591.697572:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17893:x1875544025251200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658591.697691:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17893:x1875544025251200:12345-0@lo:501:mount.lustre.0 Request processed in 123us (557us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658591.697699:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788658591.698175:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251200:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788658591.698201:0:17893:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788658591.698248:0:17893:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788658591.698257:0:17893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.698267:0:17893:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658591.698298:0:17893:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1e82c42000 10000000:01000000:3.0:1788658591.698304:0:17893:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788658591.698309:0:17893:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a1eb23f0000 10000000:01000000:3.0:1788658591.698312:0:17893:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788658591.698316:0:17893:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a1eb23f0000 from 1 10000000:01000000:3.0:1788658591.698319:0:17893:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788658591.698351:0:17893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6fac8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.698375:0:17893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6fac8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.698385:0:17893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6fac8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658591.698404:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658591.698442:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658591.698483:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1193900 going to sleep for 11 seconds 00000100:00100000:0.0:1788658591.698807:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025251328 00000100:00100000:0.0:1788658591.698813:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025251328 00000100:00100000:0.0:1788658591.698848:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658591.698857:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+12:17893:x1875544025251328:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658591.698879:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658591.698895:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81670800/0x48e67cc629c6facf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fac8 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.698921:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81670800/0x48e67cc629c6facf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fac8 expref: 13 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.698943:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81670800/0x48e67cc629c6facf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fac8 expref: 13 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.698953:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670800, rc 0) 00000100:00100000:0.0:1788658591.698998:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+13:17893:x1875544025251328:12345-0@lo:101:mount.lustre.0 Request processed in 143us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.699005:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788658591.699139:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658591.699165:0:17893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6fac8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6facf expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.699176:0:17893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6fac8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6facf expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658591.699195:0:17893:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788658591.699259:0:17893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6fac8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6facf expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.699267:0:17893:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97a00/0x48e67cc629c6fac8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6facf expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658591.699276:0:17893:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a1e82c42000 10000000:01000000:3.0:1788658591.699281:0:17893:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788658591.699284:0:17893:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a1e82c42000 from 1 10000000:01000000:3.0:1788658591.699286:0:17893:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788658591.699311:0:17893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.699318:0:17893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.699324:0:17893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658591.699338:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658591.699368:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658591.699400:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1193900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658591.699574:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025251456 00000100:00100000:2.0:1788658591.699591:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025251456 00000100:00100000:2.0:1788658591.699632:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788658591.699647:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+13:17893:x1875544025251456:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658591.699656:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658591.699665:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c6fadd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fad6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658591.699682:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c6fadd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fad6 expref: 14 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658591.699691:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a1600/0x48e67cc629c6fadd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fad6 expref: 14 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658591.699698:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1600, rc 0) 00000100:00100000:2.0:1788658591.699766:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+14:17893:x1875544025251456:12345-0@lo:101:mount.lustre.0 Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658591.699772:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658591.700061:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658591.700073:0:17893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.700080:0:17893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658591.700091:0:17893:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788658591.702595:0:17893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.702619:0:17893:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97400/0x48e67cc629c6fad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fadd expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658591.702630:0:17893:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788658591.702639:0:17893:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658591.702647:0:17893:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a1e82c42000 10000000:01000000:3.0:1788658591.702665:0:17893:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788658591.702670:0:17893:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788658591.702672:0:17893:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788658591.702734:0:17893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.702744:0:17893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.702754:0:17893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658591.702778:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658591.702846:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658591.702901:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1193900 going to sleep for 11 seconds 00000100:00100000:0.0:1788658591.702983:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025251584 00000100:00100000:0.0:1788658591.702991:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025251584 00000100:00100000:0.0:1788658591.703033:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788658591.703042:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+14:17893:x1875544025251584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658591.703054:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658591.703068:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81671e00/0x48e67cc629c6faeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fae4 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.703090:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81671e00/0x48e67cc629c6faeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fae4 expref: 15 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.703100:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81671e00/0x48e67cc629c6faeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fae4 expref: 15 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.703108:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671e00, rc 0) 00000100:00100000:0.0:1788658591.703161:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:17893:x1875544025251584:12345-0@lo:101:mount.lustre.0 Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.703169:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658591.703629:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658591.703645:0:17893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.703655:0:17893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658591.709275:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788658591.710289:0:17893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658591.722574:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788658591.722830:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788658591.722849:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788658591.722864:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788658591.722889:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788658591.722905:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788658591.722936:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788658591.722950:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788658591.722962:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788658591.722974:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788658591.722986:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788658591.722998:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788658591.723010:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788658591.723021:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788658591.723034:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788658591.723046:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788658591.723057:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788658591.723070:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788658591.723088:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788658591.723102:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788658591.723114:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788658591.723129:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788658591.723141:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788658591.723449:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788658591.723458:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788658591.723581:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658591.724766:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.726321:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1193cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658591.727416:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025251712 00000100:00100000:0.0:1788658591.727430:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025251712 00000100:00100000:0.0:1788658591.727568:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788658591.727578:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:17893:x1875544025251712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658591.727835:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:17893:x1875544025251712:12345-0@lo:501:mount.lustre.0 Request processed in 258us (3134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.727843:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658591.727963:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658591.728023:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658591.728075:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.747145:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658591.753184:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025251840 00000100:00100000:1.0:1788658591.753199:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025251840 00000100:00100000:1.0:1788658591.753269:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788658591.753280:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:17893:x1875544025251840:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658591.756107:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:17893:x1875544025251840:12345-0@lo:503:mount.lustre.0 Request processed in 2817us (28019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658591.756123:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658591.759260:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251840:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788658591.759811:0:17893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658591.759953:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658591.760029:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.760076:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658591.760225:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025251968 00000100:00100000:0.0:1788658591.760232:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025251968 00000100:00100000:0.0:1788658591.760285:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788658591.760294:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:17893:x1875544025251968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658591.761242:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:17893:x1875544025251968:12345-0@lo:502:mount.lustre.0 Request processed in 944us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.761252:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788658591.761755:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025251968:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658591.762035:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788658591.762066:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788658591.762079:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788658591.762091:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788658591.762103:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788658591.762114:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788658591.762126:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788658591.762138:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788658591.762150:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788658591.762178:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788658591.762194:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788658591.762208:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788658591.762219:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788658591.762231:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788658591.762244:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788658591.762256:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788658591.762268:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788658591.762280:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788658591.762291:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788658591.762303:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788658591.762314:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788658591.762326:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788658591.762337:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788658591.762350:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788658591.762362:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788658591.762374:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788658591.762385:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788658591.762397:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788658591.762410:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788658591.762422:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788658591.762434:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788658591.767432:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788658591.767469:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788658591.767482:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788658591.767494:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788658591.767506:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788658591.767519:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788658591.767535:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788658591.767548:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788658591.767560:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788658591.767573:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788658591.769952:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788658591.770019:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788658591.770035:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788658591.770096:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025252096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658591.773351:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.773730:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658591.780307:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025252096 00000100:00100000:3.0:1788658591.780322:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025252096 00000100:00100000:3.0:1788658591.780390:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788658591.780401:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:17893:x1875544025252096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658591.780810:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:17893:x1875544025252096:12345-0@lo:502:mount.lustre.0 Request processed in 410us (7465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658591.780818:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788658591.787943:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025252096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658591.788335:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:1.0:1788658591.788352:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788658591.789416:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658591.789430:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658591.789433:0:17897:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788658591.789440:0:17897:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788658591.789443:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658591.789458:0:17897:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8a1ebd8819c0) 00000020:00000080:2.0:1788658591.789480:0:17897:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788658591.789485:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788658591.789574:0:17897:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658591.789582:0:17897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6faf9 00000020:00000080:2.0:1788658591.789942:0:17897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788658591.789947:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658591.789952:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658591.789954:0:17897:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788658591.789957:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658591.789960:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658591.789962:0:17897:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788658591.789972:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658591.789980:0:17897:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8a1ebd880000) 00000020:00000080:2.0:1788658591.789991:0:17897:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788658591.789995:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788658591.789997:0:17897:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788658591.790000:0:17897:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788658591.790006:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788658591.790054:0:17897:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1e82c42000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788658591.790066:0:17897:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8a1ebd883380) 00000020:00000080:2.0:1788658591.790077:0:17897:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788658591.790135:0:17897:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788658591.790141:0:17897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6fb0e 00000020:00000080:2.0:1788658591.790251:0:17897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788658591.790259:0:17897:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788658591.790264:0:17897:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x48e67cc629c6fb15 00080000:01000000:2.0:1788658591.790269:0:17897:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788658591.790272:0:17897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6fb1c 00010000:00010000:0.0:1788658591.807748:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658591.868688:0:17897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788658591.877316:0:17897:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788658591.877964:0:17897:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788658591.880824:0:17897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788658591.880840:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658591.880847:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658591.880849:0:17897:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788658591.880854:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658591.880860:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658591.880861:0:17897:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788658591.880865:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788658591.880871:0:17897:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:00000080:2.0:1788658591.880913:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658591.880944:0:17897:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8a1eb3970000) 00000020:00000080:2.0:1788658591.880975:0:17897:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788658591.880993:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788658591.881077:0:17897:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788658591.881085:0:17897:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788658591.881093:0:17897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6fb2a 00010000:00080000:2.0:1788658591.881145:0:17897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d83706800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658591.887940:0:17897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788658591.894633:0:17897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788658591.894648:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788658591.894739:0:17897:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788658591.894765:0:17897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6fb31 00000100:00080000:1.0:1788658591.894777:0:17897:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658591.894783:0:17897:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8a1d83706800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658591.894818:0:17897:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f1c00 x1875544025252224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658591.896002:0:17897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788658591.896177:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788658591.896181:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788658591.896184:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658591.896189:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:0.0:1788658591.896194:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788658591.896199:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a1eb213e800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658591.896214:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7403480 x1875544025252480/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:1.0:1788658591.896216:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658591.896220:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.896223:0:17897:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000100:00080000:0.0:1788658591.896223:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:1.0:1788658591.896226:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:0.0:1788658591.896227:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788658591.896229:0:17897:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000100:00080000:0.0:1788658591.896229:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:1.0:1788658591.896230:0:17897:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788658591.896232:0:17897:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788658591.896233:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788658591.896235:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.896236:0:17897:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788658591.896239:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00080000:0.0:1788658591.896240:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1788658591.896243:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.896245:0:17897:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788658591.896248:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788658591.896271:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025252352:0@lo:400:kworker.0 00000004:01000000:1.0:1788658591.896286:0:17897:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788658591.896298:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658591.896301:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.896302:0:17897:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788658591.896305:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788658591.896306:0:17897:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788658591.896307:0:17897:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788658591.896308:0:17897:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788658591.896310:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788658591.896312:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.896313:0:17897:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788658591.896315:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788658591.896324:0:17897:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788658591.896328:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.896329:0:17897:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788658591.896332:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000100:00100000:0.0:1788658591.896336:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788658591.896337:0:17897:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:1.0:1788658591.896356:0:17897:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788658591.896359:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658591.896372:0:17897:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8a1ebf4399c0) 00000100:00100000:0.0:1788658591.896382:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00000080:1.0:1788658591.896386:0:17897:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000100:00100000:0.0:1788658591.896388:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025252608:0@lo:400:kworker.0 00000020:00000080:1.0:1788658591.896391:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788658591.896413:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658591.896446:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025252352 00000100:00100000:0.0:1788658591.896452:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025252352 00000004:00080000:1.0:1788658591.896462:0:17897:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788658591.896468:0:17897:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788658591.896474:0:17897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6fb3f 00000100:00100000:0.0:1788658591.896491:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788658591.896498:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:3649:x1875544025252352:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788658591.896502:0:17897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1eb744b000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.153@tcp at head 00000100:00100000:0.0:1788658591.896544:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:3649:x1875544025252352:12345-0@lo:400:kworker.0 Request processed in 46us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.896552:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788658591.896586:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025252608 00000100:00100000:0.0:1788658591.896589:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025252608 00000100:00100000:0.0:1788658591.896611:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658591.896617:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025252608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658591.896645:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025252608:12345-0@lo:400:kworker.0 Request processed in 28us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.896651:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788658591.896685:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1eb7400000 x1875544025252608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658591.896698:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025252608:0@lo:400:kworker.0 00000100:00100000:0.0:1788658591.896728:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025252352:0@lo:400:kworker.0 00010000:00010000:1.0:1788658591.896737:0:17897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788658591.896894:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025252224:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788658591.896937:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.896974:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025252480:0@lo:38:kworker.0 00000100:00100000:2.0:1788658591.896995:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658591.898139:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025252224 00000100:00100000:0.0:1788658591.898166:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025252224 00000100:00100000:0.0:1788658591.898195:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025252480 00000100:00100000:0.0:1788658591.898198:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025252480 00000100:00100000:0.0:1788658591.898210:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658591.898218:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025252224:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788658591.898250:0:17168:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:0.0:1788658591.898291:0:17168:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6fb46 00000004:00100000:0.0:1788658591.898314:0:17168:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788658591.898321:0:17168:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:2.0:1788658591.899014:0:17897:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788658591.900436:0:17897:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788658591.907447:0:17897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1788658591.907957:0:17168:0:(import.c:65:import_set_state_nolock()) ffff8a1e840eb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658591.908061:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875544025252224:12345-0@lo:38:llog_process_th.0 Request processed in 9840us (11121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.908072:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658591.908106:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658591.908113:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025252480:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788658591.908156:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875544025252480:12345-0@lo:38:kworker.0 Request processed in 43us (11160us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788658591.908170:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658591.908244:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658591.908256:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788658591.908265:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788658591.908271:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788658591.908273:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d83706800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658591.908295:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025252224:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788658591.908308:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658591.908311:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658591.908314:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788658591.908316:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025252480:0@lo:38:kworker.0 00000040:00080000:1.0:1788658591.908504:0:17897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788658591.908684:0:17897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:2.0:1788658591.908898:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658591.908916:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025252736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658591.908963:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.909009:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025252736 00000100:00100000:2.0:1788658591.909015:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025252736 00000100:00100000:2.0:1788658591.909053:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658591.909068:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875544025252736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658591.909099:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788658591.909139:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875544025252736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658591.909146:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658591.909192:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025252736:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788658591.915950:0:17902:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788658591.915978:0:17902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788658591.921012:0:17897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788658591.921027:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788658591.921084:0:17897:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788658591.921109:0:17897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6fb4d 00000100:00080000:1.0:1788658591.921121:0:17897:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658591.921128:0:17897:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a1eb744b000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658591.921163:0:17897:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f1180 x1875544025252864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658591.921189:0:17897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788658591.921247:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658591.921252:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.921253:0:17897:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788658591.921263:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788658591.921266:0:17897:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788658591.921267:0:17897:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788658591.921269:0:17897:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788658591.921270:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788658591.921272:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:0.0:1788658591.921272:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1788658591.921274:0:17897:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788658591.921276:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00080000:0.0:1788658591.921277:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658591.921279:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000004:1.0:1788658591.921281:0:17897:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000100:00080000:0.0:1788658591.921282:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1788658591.921284:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.921285:0:17897:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788658591.921288:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788658591.921291:0:17897:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.153@tcp to nid 0x20000c0a8ca99 (192.168.202.153@tcp) 00000020:01000000:1.0:1788658591.921317:0:17897:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788658591.921320:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788658591.921332:0:17897:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8a1ebf43cd40) 00000100:00100000:2.0:1788658591.921341:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025252864:0@lo:8:llog_process_th.0 00000020:00000080:1.0:1788658591.921344:0:17897:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788658591.921348:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000400:00000100:2.0:1788658591.921393:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025252864 offset 0 length 520: 4 00000004:00080000:1.0:1788658591.921404:0:17897:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788658591.921410:0:17897:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788658591.921414:0:17897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x48e67cc629c6fb5b 00010000:00080000:1.0:1788658591.921443:0:17897:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1ec1295800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1788658591.921652:0:17897:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788658591.921747:0:17897:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788658591.921764:0:17897:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788658591.930005:0:17897:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658591.930267:0:17897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788658591.930393:0:17897:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788658591.937158:0:17904:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788658591.938818:0:17904:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788658591.939325:0:17897:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788658591.939341:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788658591.939399:0:17897:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788658591.939432:0:17897:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6fb62 00000100:00080000:1.0:1788658591.939447:0:17897:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658591.939464:0:17897:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ec1295800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658591.939516:0:17897:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f0700 x1875544025252992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658591.939549:0:17897:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788658591.939618:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658591.939623:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.939624:0:17897:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788658591.939627:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658591.939630:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.939632:0:17897:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788658591.939634:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788658591.939636:0:17897:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788658591.939638:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658591.939641:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.939642:0:17897:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788658591.939644:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658591.939646:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.939647:0:17897:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788658591.939651:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788658591.939675:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658591.939678:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.939679:0:17897:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788658591.939682:0:17897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1788658591.939723:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658591.939728:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658591.939730:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658591.939751:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788658591.939771:0:17893:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788658591.939804:0:17893:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788658591.940098:0:17893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658591.940111:0:17893:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96a00/0x48e67cc629c6fae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6faeb expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658591.940121:0:17893:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1e82c42000 from 1 10000000:01000000:1.0:1788658591.940131:0:17893:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788658591.940166:0:17893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658591.940174:0:17893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658591.940186:0:17893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658591.940209:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788658591.940294:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658591.940383:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96000 going to sleep for 11 seconds 00000100:00100000:2.0:1788658591.940844:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025252992:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788658591.940888:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025252992 offset 0 length 520: 4 00000100:00100000:3.0:1788658591.948420:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025253120 00000100:00100000:3.0:1788658591.948437:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025253120 00000100:00100000:0.0:1788658591.948653:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788658591.948665:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+15:17893:x1875544025253120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658591.948685:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658591.948724:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fb70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fb69 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.948767:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fb69 expref: 16 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.948779:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fb69 expref: 16 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.948789:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671000, rc 0) 00000100:00100000:0.0:1788658591.948897:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+16:17893:x1875544025253120:12345-0@lo:101:mount.lustre.0 Request processed in 233us (8602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.948904:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788658591.949124:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253120:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658591.949145:0:17893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658591.949155:0:17893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658591.949730:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253248:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788658591.950077:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.950126:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3476540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658591.950334:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025253248 00000100:00100000:0.0:1788658591.950342:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025253248 00000100:00100000:0.0:1788658591.950388:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658591.950398:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+16:17893:x1875544025253248:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788658591.950419:0:17154:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788658591.953251:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788658591.953261:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788658591.953431:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+16:17893:x1875544025253248:12345-0@lo:256:mount.lustre.0 Request processed in 3030us (3350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.953444:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788658591.953655:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253248:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788658591.954254:0:17893:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658591.954272:0:17893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658591.954284:0:17893:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658591.954293:0:17893:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1e82c42000 from 1 10000000:01000000:1.0:1788658591.954295:0:17893:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658591.954327:0:17893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658591.954335:0:17893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658591.954344:0:17893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658591.954370:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788658591.954414:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658591.954465:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658591.954664:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025253376 00000100:00100000:2.0:1788658591.954672:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025253376 00000100:00100000:2.0:1788658591.954748:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658591.954764:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+16:17893:x1875544025253376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658591.954776:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658591.954794:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6fb7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fb77 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658591.954816:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6fb7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fb77 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658591.954826:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6fb7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fb77 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658591.954834:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d834a1400, rc 0) 00000100:00100000:2.0:1788658591.954872:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17893:x1875544025253376:12345-0@lo:101:mount.lustre.0 Request processed in 110us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658591.954878:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658591.954990:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658591.955006:0:17893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658591.955015:0:17893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788658591.955167:0:17893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658591.955197:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658591.955222:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658591.955241:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82e96300 going to sleep for 11 seconds 00000100:00100000:0.0:1788658591.955296:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025253504 00000100:00100000:0.0:1788658591.955300:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025253504 00000100:00100000:0.0:1788658591.955331:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788658591.955338:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17893:x1875544025253504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658591.955546:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17893:x1875544025253504:12345-0@lo:501:mount.lustre.0 Request processed in 208us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.955554:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788658591.955610:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658591.955643:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658591.955685:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658591.955853:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e85929d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658591.955939:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025253632 00000100:00100000:1.0:1788658591.955943:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025253632 00000100:00100000:1.0:1788658591.956006:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658591.956014:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17893:x1875544025253632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658591.956109:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17893:x1875544025253632:12345-0@lo:503:mount.lustre.0 Request processed in 95us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658591.956116:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788658591.956188:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253632:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788658591.956530:0:17893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788658591.956588:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658591.956611:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658591.956788:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e85929d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658591.956905:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025253760 00000100:00100000:2.0:1788658591.956909:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025253760 00000100:00100000:0.0:1788658591.956948:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788658591.956957:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17893:x1875544025253760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658591.957051:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17893:x1875544025253760:12345-0@lo:502:mount.lustre.0 Request processed in 95us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.957057:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788658591.957134:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658591.957306:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788658591.957331:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788658591.957344:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788658591.957355:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788658591.957365:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788658591.957375:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788658591.957385:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788658591.957396:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788658591.957406:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788658591.957417:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788658591.957426:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788658591.957447:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658591.957479:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658591.957537:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e85929d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658591.957571:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025253888 00000100:00100000:1.0:1788658591.957575:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025253888 00000100:00100000:1.0:1788658591.957596:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788658591.957602:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17893:x1875544025253888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658591.957679:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17893:x1875544025253888:12345-0@lo:502:mount.lustre.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658591.957685:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658591.957796:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025253888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658591.957832:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788658591.957838:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788658591.958489:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658591.958502:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.958504:0:17906:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658591.958511:0:17906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1e82c42000 00000020:00000080:1.0:1788658591.958514:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658591.958524:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658591.958527:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.958528:0:17906:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788658591.958530:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658591.958532:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.958533:0:17906:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788658591.958536:0:17906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1e82c42000 00000020:00000080:1.0:1788658591.958538:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658591.958603:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658591.958607:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.958608:0:17906:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788658591.958611:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658591.958613:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.958614:0:17906:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658591.958618:0:17906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1e82c42000 00000020:00000080:1.0:1788658591.958620:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658591.958638:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658591.958641:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.958642:0:17906:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658591.958644:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658591.958646:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.958647:0:17906:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788658591.958650:0:17906:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1e82c42000 00000020:00000080:1.0:1788658591.958652:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658591.958680:0:17906:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658591.958684:0:17906:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658591.958685:0:17906:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788658591.958688:0:17906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788658591.961686:0:17893:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788658591.961756:0:17893:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658591.961780:0:17893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.961792:0:17893:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658591.961849:0:17893:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788658591.961852:0:17893:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1e82c42000 10000000:01000000:3.0:1788658591.961854:0:17893:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1e82c42000 10000000:01000000:3.0:1788658591.961857:0:17893:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658591.961862:0:17893:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1e82c42000 from 1 10000000:01000000:3.0:1788658591.961864:0:17893:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788658591.961979:0:17893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.961989:0:17893:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.962002:0:17893:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658591.962035:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254016:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658591.962117:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658591.962165:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9889bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658591.962758:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025254016 00000100:00100000:1.0:1788658591.962766:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025254016 00000100:00100000:1.0:1788658591.962812:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788658591.962822:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17893:x1875544025254016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658591.962836:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658591.962850:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fb8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fb85 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658591.962871:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fb85 expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658591.962890:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83418800/0x48e67cc629c6fb8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fb85 expref: 18 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658591.962898:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418800, rc 0) 00000100:00100000:1.0:1788658591.962943:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254016:12345-0@lo:101:mount.lustre.0 Request processed in 122us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658591.962949:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788658591.963095:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254016:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658591.963120:0:17893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658591.963130:0:17893:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658591.964320:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788658591.965496:0:17893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658591.965724:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788658591.965754:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788658591.965772:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788658591.965790:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788658591.965805:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788658591.965821:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788658591.965835:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788658591.965853:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788658591.965866:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788658591.965900:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788658591.965920:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788658591.965933:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788658591.966150:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788658591.966168:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788658591.966184:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788658591.966199:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788658591.966216:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788658591.966231:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788658591.966244:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788658591.966257:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788658591.966270:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788658591.966282:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788658591.966301:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788658591.966317:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788658591.966347:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788658591.966363:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788658591.966377:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788658591.966451:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788658591.966475:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788658591.966480:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788658591.966588:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658591.966663:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658591.966738:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e812edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658591.966757:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025254144 00000100:00100000:1.0:1788658591.966765:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025254144 00000100:00100000:1.0:1788658591.966813:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658591.966822:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658591.966960:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254144:12345-0@lo:501:mount.lustre.0 Request processed in 139us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658591.966968:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788658591.967073:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658591.967107:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658591.967145:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658591.967163:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e812edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658591.967844:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025254272 00000100:00100000:1.0:1788658591.967852:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025254272 00000100:00100000:1.0:1788658591.967908:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788658591.967920:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658591.968017:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254272:12345-0@lo:503:mount.lustre.0 Request processed in 100us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658591.968025:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788658591.968044:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254272:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788658591.968556:0:17893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658591.968617:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658591.968681:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.968746:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3476840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658591.968831:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025254400 00000100:00100000:1.0:1788658591.968835:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025254400 00000100:00100000:1.0:1788658591.968861:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788658591.968867:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658591.968958:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254400:12345-0@lo:502:mount.lustre.0 Request processed in 91us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658591.968964:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658591.969031:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658591.969211:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788658591.969234:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788658591.969247:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788658591.969258:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788658591.969269:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788658591.969287:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788658591.969300:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788658591.969323:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788658591.969334:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788658591.969345:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788658591.969357:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788658591.969366:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788658591.969375:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788658591.969386:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788658591.969397:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788658591.969417:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788658591.969435:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788658591.969453:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788658591.969470:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788658591.969482:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788658591.969490:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788658591.969499:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788658591.969510:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788658591.969531:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788658591.969543:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788658591.969553:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788658591.969564:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788658591.969575:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788658591.969586:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788658591.969597:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788658591.969605:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788658591.969612:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788658591.969622:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788658591.969646:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788658591.969657:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788658591.969666:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788658591.969677:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788658591.969689:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788658591.969736:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788658591.969756:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788658591.969764:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788658591.969771:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788658591.969781:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788658591.969790:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788658591.969797:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788658591.969805:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788658591.969813:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788658591.969822:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788658591.969853:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658591.969914:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.969947:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3476840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658591.969959:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025254528 00000100:00100000:1.0:1788658591.969965:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025254528 00000100:00100000:1.0:1788658591.970001:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788658591.970020:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658591.970116:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254528:12345-0@lo:502:mount.lustre.0 Request processed in 107us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658591.970123:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788658591.970124:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658591.970261:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788658591.970280:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788658591.970295:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658591.970323:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.970346:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025254656 00000100:00100000:2.0:1788658591.970350:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025254656 00000100:00100000:2.0:1788658591.970377:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788658591.970384:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658591.970456:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254656:12345-0@lo:502:mount.lustre.0 Request processed in 73us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658591.970463:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788658591.970488:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3476840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658591.970496:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658591.970520:0:17893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788658591.970529:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788658591.971285:0:17911:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788658591.971304:0:17911:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8a1ebf438000) 00000020:00000080:1.0:1788658591.971327:0:17911:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788658591.971450:0:17911:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1e82c42000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788658591.971456:0:17911:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1e82c42000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788658591.971459:0:17911:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1e82c42000 3 00010000:00080000:1.0:1788658591.971502:0:17911:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1e88e5f800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.153@tcp at head 00010000:00010000:1.0:1788658591.973531:0:17911:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788658591.973773:0:17911:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788658591.973871:0:17911:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788658591.973898:0:17911:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x48e67cc629c6fb9a 00000100:00080000:0.0:1788658591.973909:0:17911:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658591.973915:0:17911:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8a1e88e5f800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658591.973956:0:17911:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7401500 x1875544025254784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788658591.973992:0:17911:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788658591.974018:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658591.974022:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658591.974024:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658591.974027:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788658591.974235:0:17911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:3.0:1788658591.974675:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875544025254784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788658591.974778:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658591.976069:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025254784 00000100:00100000:0.0:1788658591.976087:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025254784 00000100:00100000:0.0:1788658591.976133:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658591.976141:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025254784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788658591.976235:0:17164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:0.0:1788658591.976293:0:17164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x48e67cc629c6fba1 00000004:00100000:0.0:1788658591.976312:0:17164:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788658591.976344:0:17164:0:(import.c:65:import_set_state_nolock()) ffff8a1d8345c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658591.976434:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875544025254784:12345-0@lo:38:llog_process_th.0 Request processed in 292us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.976442:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788658591.976510:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1eb7401500 x1875544025254784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658591.976522:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788658591.976533:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788658591.976541:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788658591.976546:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788658591.976549:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e88e5f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788658591.976556:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875544025254784:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788658591.976996:0:17893:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788658591.977055:0:17893:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788658591.977210:0:17893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658591.977232:0:17893:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97800/0x48e67cc629c6fb85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fb8c expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788658591.977312:0:17893:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788658591.977315:0:17893:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788658591.977317:0:17893:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658591.977319:0:17893:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658591.977321:0:17893:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658591.977323:0:17893:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658591.977325:0:17893:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658591.977327:0:17893:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658591.977329:0:17893:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658591.977333:0:17893:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788658591.977336:0:17893:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658591.977338:0:17893:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788658591.977340:0:17893:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658591.977342:0:17893:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658591.977344:0:17893:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658591.977345:0:17893:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658591.977347:0:17893:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658591.977348:0:17893:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658591.977350:0:17893:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788658591.977373:0:17893:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788658591.977396:0:17893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658591.977452:0:17893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.977501:0:17893:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb34763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658591.977525:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025254912 00000100:00100000:0.0:1788658591.977532:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025254912 00000100:00100000:0.0:1788658591.977574:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788658591.977584:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17893:x1875544025254912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788658591.977609:0:17154:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788658591.977625:0:17154:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788658591.978573:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788658591.978600:0:17154:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788658591.978618:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788658591.978760:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788658591.978766:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788658591.978785:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.978802:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1d834a0200/0x48e67cc629c6faac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6faa5 expref: 18 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.978810:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fb70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fb69 expref: 18 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.978819:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.978854:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fb70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fb69 expref: 18 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.978871:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fb70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fb69 expref: 18 pid: 17156 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658591.978895:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025255040:0@lo:104: 00000100:00100000:0.0:1788658591.978955:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658591.978999:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1d834a0200/0x48e67cc629c6faac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6faa5 expref: 18 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979007:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1d834a0200/0x48e67cc629c6faac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6faa5 expref: 18 pid: 17156 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658591.979016:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025255168:0@lo:104: 00000100:00100000:0.0:1788658591.979038:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658591.979062:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec121ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658591.979106:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025255040 00000100:00100000:0.0:1788658591.979112:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025255040 00000100:00100000:0.0:1788658591.979139:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025255168 00000100:00100000:0.0:1788658591.979142:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025255168 00000100:00100000:0.0:1788658591.979159:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658591.979233:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+4:17178:x1875544025255040:12345-0@lo:104: 00010000:00010000:0.0:1788658591.979248:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979305:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658591.979312:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+4:17178:x1875544025255040:12345-0@lo:104: Request processed in 82us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.979319:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658591.979337:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658591.979345:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:17178:x1875544025255168:12345-0@lo:104: 00010000:00010000:0.0:1788658591.979352:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979385:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788658591.979390:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:17178:x1875544025255168:12345-0@lo:104: Request processed in 47us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.979396:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788658591.979417:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658591.979423:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979430:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658591.979434:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979448:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658591.979456:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658591.979462:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658591.979490:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979497:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658591.979533:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979542:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d83418a00/0x48e67cc629c6fb69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fb70 expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979557:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658591.979560:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979567:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419e00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658591.979570:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979577:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658591.979584:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658591.979597:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658591.979613:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979619:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658591.979634:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979641:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d83419e00/0x48e67cc629c6faa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6faac expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979655:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658591.979658:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658591.979659:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658591.979665:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658591.979677:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025255296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658591.979730:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658591.979774:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025255424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658591.979810:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658591.979859:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025255296 00000100:00100000:0.0:1788658591.979863:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025255296 00010000:00010000:0.0:1788658591.979893:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fb70 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fb69 expref: 19 pid: 17156 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658591.979915:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025255424 00000100:00100000:0.0:1788658591.979918:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025255424 00010000:00010000:0.0:1788658591.979941:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1d834a0200/0x48e67cc629c6faac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6faa5 expref: 20 pid: 17156 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658591.979963:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658591.979969:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:3648:x1875544025255296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658591.979980:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658591.979986:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fb70 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fb69 expref: 20 pid: 17156 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.979996:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fb70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fb69 expref: 20 pid: 17156 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980012:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658591.980042:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:3648:x1875544025255296:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.980048:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658591.980061:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658591.980066:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:3649:x1875544025255424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658591.980074:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658591.980079:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1d834a0200/0x48e67cc629c6faac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6faa5 expref: 19 pid: 17156 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980087:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1d834a0200/0x48e67cc629c6faac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6faa5 expref: 19 pid: 17156 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980099:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980108:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788658591.980130:0:17147:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003888168s 00010000:00010000:0.0:1788658591.980134:0:17147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980142:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980149:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980157:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980665:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658591.980672:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980682:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980692:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980721:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658591.980755:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:3649:x1875544025255424:12345-0@lo:103:ldlm_bl.0 Request processed in 688us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.980762:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658591.980815:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025255424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658591.980842:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025255296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658591.980875:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fb70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fb69 expref: 18 pid: 17156 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658591.980902:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7401500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025255040:0@lo:104: 00010000:00010000:0.0:1788658591.980914:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d834a0200/0x48e67cc629c6faac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6faa5 expref: 17 pid: 17156 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658591.980921:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025255168:0@lo:104: 00010000:00010000:0.0:1788658591.980937:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980945:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980952:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658591.980958:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81670600/0x48e67cc629c6fba8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658591.981023:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+16:17893:x1875544025254912:12345-0@lo:253:mount.lustre.0 Request processed in 3442us (3572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658591.981032:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788658591.981069:0:17893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:17893:1875544025254912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788658591.981079:0:17893:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788658591.981082:0:17893:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788658591.981084:0:17893:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788658591.981085:0:17893:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658591.981086:0:17893:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658591.981094:0:17893:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658591.981095:0:17893:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658591.981096:0:17893:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788658591.981098:0:17893:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658591.981100:0:17893:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788658591.981113:0:17893:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:3.0:1788658591.991787:0:17893:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788658591.991849:0:17917:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788658591.991853:0:17917:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788658591.992904:0:17918:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788658591.992961:0:17893:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788658591.993469:0:17919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875544025255552:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788658591.993503:0:17918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658591.993569:0:17919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1788658591.993582:0:17893:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1788658591.993611:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025255552 00000100:00100000:2.0:1788658591.993617:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025255552 00000040:00080000:3.0:1788658591.993624:0:17893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658591.993662:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658591.993671:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17919:x1875544025255552:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788658591.994138:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17919:x1875544025255552:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 466us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658591.994148:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658591.994179:0:17919:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f24b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658591.994206:0:17919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875544025255552:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788658591.994613:0:17919:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788658591.994650:0:17919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875544025255680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788658591.994688:0:17919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:3.0:1788658591.996040:0:17893:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788658591.996064:0:17893:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788658591.996238:0:17893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658591.996526:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025255680 00000100:00100000:2.0:1788658591.996536:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025255680 00000100:00100000:2.0:1788658591.996589:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658591.996600:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17919:x1875544025255680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788658591.996776:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17919:x1875544025255680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 179us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658591.996784:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658591.996812:0:17919:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f24b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658591.996849:0:17919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875544025255680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788658591.996941:0:17919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17919:1875544025255808:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788658591.996982:0:17919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658591.998549:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025255808 00000100:00100000:2.0:1788658591.998563:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025255808 00000100:00100000:2.0:1788658591.998619:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658591.998628:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17919:x1875544025255808:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788658591.998699:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17919:x1875544025255808:12345-0@lo:900:lod0001_rec0000.0 Request processed in 72us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658591.998724:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658591.998761:0:17919:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f24bc00 going to sleep for 11 seconds 00010000:00080000:2.0:1788658591.998783:0:17919:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a1d83c20000 x1875544025255808/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788658607 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658591.998795:0:17919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17919:1875544025255808:0@lo:900:lod0001_rec0000.0 00000040:00080000:3.0:1788658592.000591:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788658592.000811:0:17919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875544025255936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788658592.000954:0:17919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658592.000997:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025255936 00000100:00100000:2.0:1788658592.001004:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025255936 00000100:00100000:2.0:1788658592.001058:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658592.001067:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17919:x1875544025255936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788658592.001139:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17919:x1875544025255936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658592.001146:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658592.001169:0:17919:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f24b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658592.001190:0:17919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17919:1875544025255936:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788658592.001599:0:17919:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658592.001662:0:17918:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788658592.001739:0:17918:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788658592.002925:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788658592.003091:0:17893:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788658592.003635:0:17893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788658592.004592:0:17893:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1788658592.006791:0:17893:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:2.0:1788658592.009324:0:17919:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788658592.009421:0:17919:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1788658592.009427:0:17919:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1788658592.016176:0:17893:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788658592.016221:0:17893:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa33e416f3988 00100000:10000000:0.0:1788658592.016230:0:17893:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788658592.017327:0:17893:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788658592.017369:0:17893:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788658592.017390:0:17893:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788658592.017423:0:17893:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788658592.021508:0:17893:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658592.021803:0:17893:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788658592.446951:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:0.0:1788658592.832395:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658593.023791:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658593.470789:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:2.0:1788658593.855516:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788658593.920970:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788658593.920981:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1e82c42000 from 8 10000000:01000000:2.0:1788658593.920988:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658593.921051:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658593.921066:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658593.921081:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658593.921118:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025256064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658593.921242:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658593.921437:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658593.921500:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025256064 00000100:00100000:3.0:1788658593.921527:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025256064 00000100:00100000:3.0:1788658593.921601:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788658593.921612:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+16:17159:x1875544025256064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658593.921630:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658593.921649:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6fbb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fbaf expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658593.921682:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6fbb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fbaf expref: 17 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658593.921695:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6fbb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fbaf expref: 17 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658593.921742:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96e00, rc 0) 00000100:00100000:3.0:1788658593.921793:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17159:x1875544025256064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658593.921800:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788658593.922080:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025256064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658593.922100:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658593.922112:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658593.922175:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025256192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788658593.922229:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658593.923005:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658593.930961:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025256192 00000100:00100000:3.0:1788658593.930993:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025256192 00000100:00100000:3.0:1788658593.931594:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788658593.931609:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17159:x1875544025256192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788658593.931649:0:17154:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788658593.931680:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788658593.931684:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788658593.931898:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17159:x1875544025256192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 292us (9667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658593.931907:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788658593.938046:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025256192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788658593.938134:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658593.938146:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658593.938160:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658593.938173:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658593.938175:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1eb751f000 from 8 10000000:01000000:3.0:1788658593.938178:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658593.938371:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658593.938381:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658593.938392:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658593.938415:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025256320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658593.938487:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658593.938543:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658593.940775:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025256320 00000100:00100000:3.0:1788658593.940792:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025256320 00000100:00100000:3.0:1788658593.940876:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658593.940888:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17159:x1875544025256320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658593.940908:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658593.940932:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fbc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fbbd expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658593.940999:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fbbd expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658593.941014:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fbbd expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658593.941027:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97600, rc 0) 00000100:00100000:3.0:1788658593.941129:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17159:x1875544025256320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (2641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658593.941137:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658593.941222:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025256320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658593.941556:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658593.941570:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658593.941656:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025256448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788658593.941747:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658593.941787:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788658593.941807:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025256448 00000100:00100000:3.0:1788658593.941813:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025256448 00000100:00100000:3.0:1788658593.941847:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788658593.941855:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17159:x1875544025256448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788658593.943850:0:17154:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788658593.944447:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788658593.944460:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788658593.944645:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17159:x1875544025256448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2786us (2895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658593.944659:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788658593.946238:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025256448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788658593.948124:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658593.948139:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658593.948154:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658594.055157:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658594.494852:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:0.0:1788658594.879352:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658595.528287:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:0.0:1788658595.903947:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658596.542797:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 0 seconds 00010000:00010000:0.0:1788658596.927823:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788658597.311404:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788658597.311414:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788658597.311419:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658597.311435:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8a1eb213e800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658597.311488:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb98380 x1875544025256704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658597.311510:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658597.311514:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658597.311517:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658597.311520:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658597.311551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658597.311555:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658597.311558:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658597.311561:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788658597.311603:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025257088:0@lo:400:kworker.0 00000100:00100000:2.0:1788658597.311612:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025256576:0@lo:400:kworker.0 00000100:00100000:0.0:1788658597.314791:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025256832:0@lo:400:kworker.0 00000100:00100000:2.0:1788658597.325193:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658597.330446:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658597.330568:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025256960:0@lo:400:kworker.0 00000100:00100000:3.0:1788658597.330632:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658597.330841:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025257088 00000100:00100000:3.0:1788658597.330856:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025257088 00000100:00100000:0.0:1788658597.332608:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658597.332726:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025256704:0@lo:38:kworker.0 00000100:00100000:0.0:1788658597.332776:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658597.332937:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025256832 00000100:00100000:0.0:1788658597.332947:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025256832 00000100:00100000:2.0:1788658597.333457:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025256960 00000100:00100000:2.0:1788658597.333463:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025256960 00000100:00100000:3.0:1788658597.337283:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658597.337316:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025257088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658597.337444:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025257088:12345-0@lo:400:kworker.0 Request processed in 148us (7008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658597.337451:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658597.337824:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025256704 00000100:00100000:2.0:1788658597.337842:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025256704 00000100:00100000:2.0:1788658597.337876:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658597.337895:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025256960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658597.338006:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025256960:12345-0@lo:400:kworker.0 Request processed in 121us (7373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658597.338014:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658597.338032:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658597.338037:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875544025256704:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788658597.338075:0:17167:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:2.0:1788658597.338151:0:17167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6fbcb 00000004:00100000:2.0:1788658597.338173:0:17167:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788658597.338182:0:17167:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788658597.338887:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025256576 00000100:00100000:2.0:1788658597.338896:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025256576 00000100:00100000:2.0:1788658597.338948:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658597.338957:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:3650:x1875544025256576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658597.339014:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:3650:x1875544025256576:12345-0@lo:400:kworker.0 Request processed in 59us (13834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658597.339021:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658597.339099:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025256576:0@lo:400:kworker.0 00000100:00100000:2.0:1788658597.339175:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025257216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658597.339216:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658597.340799:0:17168:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788658597.340824:0:17168:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788658597.341992:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025257216 00000100:00100000:2.0:1788658597.342008:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025257216 00000100:00100000:2.0:1788658597.342202:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658597.342215:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025257216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658597.342283:0:18107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788658597.342414:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025257216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 201us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658597.342423:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658597.342500:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025257216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658597.343894:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658597.343921:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025256832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658597.343975:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025256960:0@lo:400:kworker.0 00000100:00100000:0.0:1788658597.344038:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025256832:12345-0@lo:400:kworker.0 Request processed in 130us (11437us total) trans 0 rc 0/0 00010000:00080000:3.0:1788658597.344047:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1ebdb99c00 x1875544025257088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658597.344049:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658597.344068:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025257088:0@lo:400:kworker.0 00010000:00080000:0.0:1788658597.344127:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1ebdb9aa00 x1875544025256832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658597.344142:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025256832:0@lo:400:kworker.0 00000100:00080000:0.0:1788658597.366178:0:17167:0:(import.c:65:import_set_state_nolock()) ffff8a1eb5e63000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658597.366309:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875544025256704:12345-0@lo:38:kworker.0 Request processed in 28268us (33529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658597.366323:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788658597.366790:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788658597.366804:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788658597.366812:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788658597.366815:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb213e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788658597.366837:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000008c5c04d3): req@ffff8a1d83c20700 x1875544025249664/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658597.366861:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025256704:0@lo:38:kworker.0 00000100:00100000:3.0:1788658597.366957:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658597.367001:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec134ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658597.367018:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025249664 00000100:00100000:3.0:1788658597.367025:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025249664 00000100:00100000:3.0:1788658597.367071:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658597.367081:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17203:x1875544025249664:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658597.367179:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17203:x1875544025249664:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658597.367197:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658597.367230:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17203:1875544025249664:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788658597.367268:0:17203:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788658597.367323:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17203:1875544025257344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658597.367356:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658597.367379:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658597.367406:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025257344 00000100:00100000:3.0:1788658597.367410:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025257344 00000100:00100000:3.0:1788658597.367440:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658597.367445:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17203:x1875544025257344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658597.367548:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17203:x1875544025257344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 103us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658597.367557:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658597.367582:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17203:1875544025257344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658597.367668:0:17203:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17203:1875544025257472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658597.367694:0:17203:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658597.367740:0:17203:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9812b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658597.367752:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025257472 00000100:00100000:3.0:1788658597.367756:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025257472 00000100:00100000:3.0:1788658597.367776:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658597.367783:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17203:x1875544025257472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788658597.367837:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17203:x1875544025257472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 55us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658597.367844:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658597.367875:0:17203:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17203:1875544025257472:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788658597.367918:0:17203:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658597.369972:0:17203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788658597.370094:0:17203:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1788658597.370101:0:17203:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1788658597.371015:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025257600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658597.371130:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658597.371224:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025257600 00000100:00100000:0.0:1788658597.371233:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025257600 00000100:00100000:0.0:1788658597.371283:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658597.371294:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025257600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658597.371338:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788658597.371982:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025257600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 686us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658597.371993:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658597.372055:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025257600:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788658597.953734:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788658598.575477:0:18163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788658598.975666:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788658599.845648:0:18215:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658599.846149:0:18215:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788658600.004692:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658600.575992:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788658600.797398:0:18266:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658600.797862:0:18266:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788658601.027393:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658601.407102:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658591/real 1788658591] req@ffff8a1d834f0700 x1875544025252992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658601 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658601.407142:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d834f0700 x1875544025252992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658601 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658601.407152:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658591/real 1788658591] req@ffff8a1d834f1180 x1875544025252864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658601 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658601.407163:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d834f1180 x1875544025252864/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658601 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788658601.407182:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658601.407204:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788658601.407227:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025252992:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788658601.407233:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb744b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658601.407239:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788658601.407243:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025252864:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788658601.407554:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658601.407568:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658601.407571:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658601.407574:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658601.407591:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658601.407594:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788658601.407597:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1eb744b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658601.407602:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1788658601.407608:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788658601.407616:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a1eb744b000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658601.407638:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7402d80 x1875544025258240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788658601.407649:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658601.407652:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788658601.407654:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658601.407657:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1788658601.407660:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788658601.407668:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ec1295800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658601.407679:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7403800 x1875544025258368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658601.407727:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025257728:0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.407802:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658601.407842:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025258496:0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.407925:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658601.407953:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658601.407959:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025258112:0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.408005:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658601.408043:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025257728 00000100:00100000:0.0:1788658601.408051:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025257728 00000100:00100000:0.0:1788658601.408096:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788658601.408105:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:3648:x1875544025257728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.408154:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:3648:x1875544025257728:12345-0@lo:400:kworker.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658601.408161:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788658601.408196:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025258112 00000100:00100000:0.0:1788658601.408199:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025258112 00000100:00100000:0.0:1788658601.408224:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658601.408230:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025258112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.408262:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025258112:12345-0@lo:400:kworker.0 Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658601.408269:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658601.408316:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025258112:0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.408325:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025257728:0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.408513:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025257984:0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.408542:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658601.408573:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658601.408578:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025257856:0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.408599:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658601.408636:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025258496 00000100:00100000:0.0:1788658601.408640:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025258496 00000100:00100000:0.0:1788658601.408665:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025257984 00000100:00100000:0.0:1788658601.408667:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025257984 00000100:00100000:0.0:1788658601.408681:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658601.408686:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025258496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.408745:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025258496:12345-0@lo:400:kworker.0 Request processed in 58us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658601.408752:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658601.408765:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658601.408770:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025257984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.408800:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025257984:12345-0@lo:400:kworker.0 Request processed in 30us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658601.408806:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658601.408822:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025257856 00000100:00100000:0.0:1788658601.408826:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025257856 00000100:00100000:0.0:1788658601.408845:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788658601.408851:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025257856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658601.408880:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875544025257856:12345-0@lo:400:kworker.0 Request processed in 29us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658601.408886:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788658601.408912:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025257856:0@lo:400:kworker.0 00010000:00080000:0.0:1788658601.408924:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1eb7400e00 x1875544025257984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658601.408933:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025257984:0@lo:400:kworker.0 00010000:00080000:0.0:1788658601.408955:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1eb7403b80 x1875544025258496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658601.408971:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025258496:0@lo:400:kworker.0 00000100:00100000:1.0:1788658601.409167:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025258240:0@lo:8:kworker.0 00000400:00000100:1.0:1788658601.409196:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025258240 offset 0 length 520: 4 00000100:00100000:1.0:1788658601.409218:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025258368:0@lo:8:kworker.0 00000400:00000100:1.0:1788658601.409236:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025258368 offset 0 length 520: 4 00000020:00000080:3.0:1788658601.996469:0:18314:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdeb4e8c60 20000000:00000080:3.0:1788658601.996488:0:18314:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1eb395bc00 uarg=0000000000000000 20000000:01000000:3.0:1788658601.996534:0:18314:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788658601.996543:0:18314:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788658601.996756:0:18314:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788658601.997483:0:18315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788658601.997967:0:18314:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788658602.005906:0:18314:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788658602.005949:0:18314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658602.005971:0:18314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fa7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fa74 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658602.005980:0:18314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6fb7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fb77 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658602.005988:0:18314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658602.006037:0:18314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6fb7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fb77 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658602.006054:0:18314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6fb7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fb77 expref: 17 pid: 17157 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658602.006070:0:18314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18314:1875544025258624:0@lo:104: 00000100:00100000:3.0:1788658602.006149:0:18314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788658602.006426:0:18314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fa7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fa74 expref: 17 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658602.006435:0:18314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fa7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fa74 expref: 17 pid: 17157 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658602.006443:0:18314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18314:1875544025258752:0@lo:104: 00000100:00100000:3.0:1788658602.006467:0:18314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658602.006819:0:18314:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e989a9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658602.008334:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025258624 00000100:00100000:0.0:1788658602.008347:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025258624 00000100:00100000:1.0:1788658602.009164:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025258752 00000100:00100000:1.0:1788658602.009173:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025258752 00000100:00100000:1.0:1788658602.009208:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658602.009218:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+4:18314:x1875544025258624:12345-0@lo:104: 00010000:00010000:1.0:1788658602.009237:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.009354:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658602.009361:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+4:18314:x1875544025258624:12345-0@lo:104: Request processed in 145us (3211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658602.009368:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658602.009389:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658602.009395:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:18314:x1875544025258752:12345-0@lo:104: 00010000:00010000:1.0:1788658602.009405:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.009440:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788658602.009458:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:18314:x1875544025258752:12345-0@lo:104: Request processed in 63us (2990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658602.009464:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788658602.009485:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658602.009491:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.009499:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658602.009503:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.009513:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658602.009520:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658602.009526:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788658602.009779:0:18314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18314:1875544025258624:0@lo:104: 00000100:00100000:3.0:1788658602.009792:0:18314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18314:1875544025258752:0@lo:104: 00010000:00010000:3.0:1788658602.009822:0:18314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.009907:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.009914:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788658602.009963:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025258880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658602.010008:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788658602.010068:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.010076:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d83419400/0x48e67cc629c6fb77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fb7e expref: -99 pid: 17893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.010092:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658602.010095:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.010114:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658602.010117:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.010124:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658602.010130:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658602.010136:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788658602.010152:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.010158:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658602.010208:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658602.010317:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025258880 00000100:00100000:0.0:1788658602.010323:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025258880 00010000:00010000:0.0:1788658602.010346:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6fb7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fb77 expref: 18 pid: 17157 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658602.010369:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658602.010376:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:3649:x1875544025258880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658602.010387:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658602.010392:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6fb7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fb77 expref: 18 pid: 17157 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658602.010402:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6fb7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fb77 expref: 18 pid: 17157 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658602.010416:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d834a1400/0x48e67cc629c6fb7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fb77 expref: 18 pid: 17157 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658602.010429:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658602.010535:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.010554:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d834a0400/0x48e67cc629c6fa74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fa7b expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.010568:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658602.010570:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658602.010571:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658602.010840:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025259008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658602.010872:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658602.010957:0:17147:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788658602.010967:0:17147:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788658602.011235:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025259008 00000100:00100000:1.0:1788658602.011240:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025259008 00010000:00010000:1.0:1788658602.011260:0:17147:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fa7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fa74 expref: 18 pid: 17157 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658602.011288:0:17147:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788658602.011295:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658602.011312:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:3650:x1875544025259008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658602.011322:0:17147:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658602.011326:0:17147:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fa7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fa74 expref: 18 pid: 17157 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011335:0:17147:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fa7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fa74 expref: 18 pid: 17157 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011347:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fa7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fa74 expref: 18 pid: 17157 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011361:0:17147:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011369:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011383:0:17147:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011390:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011398:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011405:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011417:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658602.011422:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011430:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011446:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658602.011457:0:17147:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658602.011491:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:3650:x1875544025259008:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658602.011499:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658602.011532:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025259008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658602.011854:0:18314:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658602.011862:0:18314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658602.011869:0:18314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96c00/0x48e67cc629c6fbd2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658602.013799:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+16:3649:x1875544025258880:12345-0@lo:103:ldlm_bl.0 Request processed in 3415us (3783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658602.013816:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658602.016535:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025258880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658602.049389:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658602.430817:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658587/real 1788658587] req@ffff8a1d834f3480 x1875544025250688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658602.430860:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d834f3480 x1875544025250688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658602.430871:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658587/real 1788658587] req@ffff8a1d834f1880 x1875544025250816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658602.430893:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1d834f1880 x1875544025250816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788658602.430915:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3234000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658602.430934:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788658602.430946:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025250688:0@lo:8:kworker.0 00000100:00080000:1.0:1788658602.430952:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658602.430959:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788658602.430961:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025250816:0@lo:8:kworker.0 00000100:00080000:0.0:1788658602.431215:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658602.431220:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788658602.431229:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3234000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658602.431234:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:0.0:1788658602.431240:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788658602.431248:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1eb3234000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658602.431271:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7400e00 x1875544025259264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788658602.431287:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658602.431291:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788658602.431292:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658602.431296:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:0.0:1788658602.431298:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788658602.431302:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1eb3235800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658602.431312:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7402a00 x1875544025259392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788658602.431355:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658602.431358:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658602.431360:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658602.431363:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788658602.431392:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025259136:0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.431475:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658602.431507:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658602.431513:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025259520:0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.431538:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658602.431573:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025259776:0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.431605:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658602.431623:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658602.431628:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025259648:0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.431648:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658602.431677:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025259136 00000100:00100000:0.0:1788658602.431684:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025259136 00000100:00100000:0.0:1788658602.431740:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025259648 00000100:00100000:0.0:1788658602.431743:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025259648 00000100:00100000:0.0:1788658602.431760:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788658602.431768:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025259136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.431824:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025259136:12345-0@lo:400:kworker.0 Request processed in 55us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658602.431832:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788658602.431862:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788658602.431869:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025259648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.432073:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025259648:12345-0@lo:400:kworker.0 Request processed in 203us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658602.432080:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788658602.432098:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025259520 00000100:00100000:0.0:1788658602.432101:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025259520 00000100:00100000:0.0:1788658602.432124:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025259776 00000100:00100000:0.0:1788658602.432127:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025259776 00000100:00100000:0.0:1788658602.432139:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658602.432145:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025259520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.432176:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025259520:12345-0@lo:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658602.432182:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658602.432204:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658602.432210:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025259776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.432239:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025259776:12345-0@lo:400:kworker.0 Request processed in 29us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658602.432245:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788658602.432287:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d8379a300 x1875544025259520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658602.432299:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025259520:0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.432309:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025259136:0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.432353:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025259648:0@lo:400:kworker.0 00010000:00080000:0.0:1788658602.432362:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d83799880 x1875544025259776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658602.432371:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025259776:0@lo:400:kworker.0 00000100:00100000:0.0:1788658602.432394:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025259264:0@lo:8:kworker.0 00000400:00000100:0.0:1788658602.432418:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025259264 offset 0 length 520: 4 00000100:00100000:1.0:1788658602.432585:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025259904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658602.432613:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658602.432649:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025259904 00000100:00100000:1.0:1788658602.432653:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025259904 00000100:00100000:1.0:1788658602.432678:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788658602.432684:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025259904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658602.432737:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788658602.432778:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875544025259904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658602.432785:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658602.433014:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025259392:0@lo:8:kworker.0 00000400:00000100:0.0:1788658602.433040:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544025259392 offset 0 length 520: 4 00000100:00100000:1.0:1788658602.433214:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025259904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658602.437168:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025260032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658602.437270:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658602.437429:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025260032 00000100:00100000:0.0:1788658602.437449:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025260032 00000100:00100000:0.0:1788658602.437512:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658602.437522:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025260032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658602.437559:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788658602.441832:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025260032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4297us (4546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658602.441861:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658602.442399:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025260032:0@lo:41:osp-pre-0-1.0 00000001:00100000:3.0:1788658602.947601:0:17894:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788658603.071806:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788658603.722460:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658603.722470:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1e82c42000 from 13 10000000:01000000:2.0:1788658603.722478:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658603.722551:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658603.722563:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658603.722575:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658603.722601:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658603.722957:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658603.723003:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658603.723075:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025260160 00000100:00100000:3.0:1788658603.723084:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025260160 00000100:00100000:3.0:1788658603.723181:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788658603.723191:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+16:17159:x1875544025260160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658603.723205:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658603.723220:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b97000/0x48e67cc629c6fbe0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fbd9 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658603.723259:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b97000/0x48e67cc629c6fbe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fbd9 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658603.723270:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b97000/0x48e67cc629c6fbe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fbd9 expref: 17 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658603.723279:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97000, rc 0) 00000100:00100000:3.0:1788658603.723334:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17159:x1875544025260160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658603.723342:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788658603.723430:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658603.723446:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658603.723455:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658603.723523:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658603.723549:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658603.727150:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658603.727286:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025260288 00000100:00100000:0.0:1788658603.727298:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025260288 00000100:00100000:0.0:1788658603.727354:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788658603.727364:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17159:x1875544025260288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658603.727557:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17159:x1875544025260288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (4006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658603.727566:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788658603.727680:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658603.727755:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658603.727816:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658603.728059:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025260416 00000100:00100000:0.0:1788658603.728065:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025260416 00000100:00100000:0.0:1788658603.728089:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788658603.728095:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17159:x1875544025260416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658603.728190:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17159:x1875544025260416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658603.728198:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788658603.728266:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658603.728281:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788658603.735411:0:18384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788658603.738000:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788658603.738051:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658603.738065:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658603.738079:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658603.738092:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658603.738096:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1eb751f000 from 13 10000000:01000000:0.0:1788658603.738099:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658603.738148:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658603.738173:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658603.738185:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658603.738213:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658603.738287:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658603.738333:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e85848540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658603.738416:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025260544 00000100:00100000:3.0:1788658603.738426:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025260544 00000100:00100000:3.0:1788658603.738482:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788658603.738492:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+17:17159:x1875544025260544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658603.738505:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658603.738518:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96200/0x48e67cc629c6fbee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fbe7 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658603.738541:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96200/0x48e67cc629c6fbee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fbe7 expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658603.738553:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96200/0x48e67cc629c6fbee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fbe7 expref: 18 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658603.738561:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96200, rc 0) 00000100:00100000:3.0:1788658603.738615:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17159:x1875544025260544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658603.738632:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658603.738754:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658603.738770:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658603.738779:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658603.738866:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658603.738893:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658603.738919:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788658603.739104:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025260672 00000100:00100000:3.0:1788658603.739109:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025260672 00000100:00100000:3.0:1788658603.739127:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788658603.739133:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17159:x1875544025260672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658603.739250:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17159:x1875544025260672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658603.739258:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788658603.739342:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658603.739370:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658603.739422:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658603.739452:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788658603.739499:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025260800 00000100:00100000:3.0:1788658603.739502:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025260800 00000100:00100000:3.0:1788658603.739520:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788658603.739526:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17159:x1875544025260800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658603.739614:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:17159:x1875544025260800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658603.739621:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788658603.739796:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025260800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788658603.740596:0:18385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788658603.745175:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788658603.745227:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658603.745241:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658603.745253:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658604.094989:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658604.287543:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788658605.119528:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658606.154898:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658607.176724:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658607.552861:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658607.552889:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025260928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658607.552963:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658607.553025:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025260928 00000100:00100000:1.0:1788658607.553040:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025260928 00000100:00100000:1.0:1788658607.553087:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788658607.553095:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025260928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658607.553128:0:18107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788658607.553172:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025260928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658607.553179:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788658607.553234:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025260928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658607.553468:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658607.553479:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025261056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658607.553511:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658607.553563:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025261056 00000100:00100000:3.0:1788658607.553567:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025261056 00000100:00100000:3.0:1788658607.553597:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658607.553604:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025261056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658607.553629:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788658607.553807:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025261056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 202us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658607.553919:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658607.553963:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025261056:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788658607.558103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658607.558112:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658607.558115:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658607.558118:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658607.558131:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658607.558134:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658607.558136:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658607.558139:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788658607.558197:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025261312:0@lo:400:kworker.0 00000100:00100000:2.0:1788658607.558264:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658607.558307:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658607.558313:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025261184:0@lo:400:kworker.0 00000100:00100000:2.0:1788658607.558341:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658607.558375:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025261440:0@lo:400:kworker.0 00000100:00100000:2.0:1788658607.558397:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658607.558431:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025261184 00000100:00100000:2.0:1788658607.558439:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025261184 00000100:00100000:2.0:1788658607.558490:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788658607.558499:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:3648:x1875544025261184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658607.558559:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:3648:x1875544025261184:12345-0@lo:400:kworker.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658607.558566:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788658607.558923:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025261184:0@lo:400:kworker.0 00000100:00100000:1.0:1788658607.559775:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025261312 00000100:00100000:1.0:1788658607.559784:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025261312 00000100:00100000:1.0:1788658607.559841:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025261440 00000100:00100000:1.0:1788658607.559846:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025261440 00000100:00100000:1.0:1788658607.559866:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658607.559874:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025261312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658607.559945:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025261312:12345-0@lo:400:kworker.0 Request processed in 73us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658607.559952:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788658607.559969:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658607.559975:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025261440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658607.560007:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025261440:12345-0@lo:400:kworker.0 Request processed in 33us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658607.560013:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788658607.561087:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d83c20380 x1875544025261312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658607.561104:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025261312:0@lo:400:kworker.0 00010000:00080000:2.0:1788658607.561144:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d83c22300 x1875544025261440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658607.561153:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025261440:0@lo:400:kworker.0 00010000:00010000:0.0:1788658608.195812:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658609.217551:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788658609.516641:0:18663:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788658609.516647:0:18663:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788658609.516648:0:18663:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788658609.516912:0:18663:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1e88e5d000 00000020:01000004:1.0:1788658609.516927:0:18663:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788658609.516947:0:18663:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788658609.516975:0:18663:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a1eb4868000) 00000020:00000080:1.0:1788658609.516994:0:18663:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788658609.589551:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788658609.592376:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788658609.592741:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788658609.593366:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788658609.593725:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788658609.594016:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788658609.594226:0:18663:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1788658609.598097:0:18663:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788658609.598331:0:18663:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788658609.598345:0:18663:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788658609.598359:0:18663:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x48e67cc629c6fbfc 00000020:01000004:1.0:1788658609.598366:0:18663:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788658609.598468:0:18663:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788658609.598473:0:18663:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788658609.598479:0:18663:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788658609.598486:0:18663:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788658609.598500:0:18663:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a1eb486b380) 00000020:00000080:1.0:1788658609.598512:0:18663:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1788658609.600447:0:18663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658609.600636:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788658609.600641:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788658609.609448:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788658609.609465:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788658609.610361:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788658609.610371:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788658609.611760:0:18663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658609.613796:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788658609.613807:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788658609.615302:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788658609.615313:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788658609.634549:0:18663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658609.635083:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788658609.635091:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788658609.636484:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788658609.636499:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788658609.638277:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788658609.638292:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788658609.640563:0:18663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658609.641199:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788658609.641207:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788658609.642030:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788658609.642038:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788658609.707200:0:18663:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658609.707579:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788658609.707586:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788658609.709804:0:18663:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788658609.711366:0:18663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788658609.713198:0:18663:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788658609.713242:0:18663:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788658609.713260:0:18663:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788658609.751182:0:18663:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788658609.751238:0:18663:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.153@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788658609.751243:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788658609.751245:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658609.751246:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658609.751247:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658609.751248:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658609.751249:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658609.751250:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658609.751252:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658609.751253:0:18663:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658609.751257:0:18663:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788658609.751259:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658609.751261:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658609.751262:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658609.751263:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658609.751264:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658609.751265:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658609.751266:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658609.751267:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658609.751268:0:18663:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658609.751295:0:18663:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788658609.751577:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025261568:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658609.751684:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658609.751975:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d833923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658609.756183:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025261568 00000100:00100000:0.0:1788658609.756200:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025261568 00000100:00100000:0.0:1788658609.756276:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788658609.756287:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:18663:x1875544025261568:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788658609.756327:0:17156:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788658609.756331:0:17156:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788658609.756336:0:17156:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788658609.757311:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:18663:x1875544025261568:12345-0@lo:253:mount.lustre.0 Request processed in 1018us (5618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658609.757323:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788658609.757472:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025261568:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788658609.757488:0:18663:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788658609.757491:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658609.757493:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788658609.757494:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658609.757495:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658609.757496:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658609.757497:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658609.757498:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788658609.757500:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658609.757501:0:18663:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788658609.757526:0:18663:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1e88e5d000 from lustre-OST0000 10000000:01000000:3.0:1788658609.757569:0:18663:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788658609.757573:0:18663:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788658609.757584:0:18663:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1eb23f0000 local copy 00010000:00010000:3.0:1788658609.757598:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658609.757807:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025261696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658609.757845:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658609.757881:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ea1fe4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658609.759542:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025261696 00000100:00100000:1.0:1788658609.759557:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025261696 00000100:00100000:1.0:1788658609.759635:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788658609.759647:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:18663:x1875544025261696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658609.759790:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:18663:x1875544025261696:12345-0@lo:501:mount.lustre.0 Request processed in 145us (1943us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658609.759804:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788658609.760988:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025261696:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788658609.761018:0:18663:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788658609.761062:0:18663:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788658609.761071:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.761082:0:18663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658609.761118:0:18663:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1e88e5d000 10000000:01000000:3.0:1788658609.761123:0:18663:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788658609.761130:0:18663:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788658609.761132:0:18663:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658609.761137:0:18663:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788658609.761139:0:18663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788658609.761173:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.762025:0:18663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.762048:0:18663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658609.762079:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025261824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658609.762155:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658609.762205:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ea1fe4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658609.762333:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025261824 00000100:00100000:0.0:1788658609.762342:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025261824 00000100:00100000:0.0:1788658609.762403:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788658609.762414:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+18:18663:x1875544025261824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658609.762429:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658609.762448:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fc11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fc0a expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.762476:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fc11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fc0a expref: 19 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.762487:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81671000/0x48e67cc629c6fc11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fc0a expref: 19 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.762496:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81671000, rc 0) 00000100:00100000:0.0:1788658609.762541:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:18663:x1875544025261824:12345-0@lo:101:mount.lustre.0 Request processed in 129us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658609.762563:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788658609.762641:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025261824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658609.762658:0:18663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.762669:0:18663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658609.765765:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788658609.769368:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658609.773314:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788658609.773639:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788658609.773667:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788658609.773683:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788658609.773810:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788658609.773831:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788658609.773856:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788658609.773862:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788658609.774031:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025261952:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658609.774104:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.774212:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658609.777047:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025261952 00000100:00100000:1.0:1788658609.777069:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025261952 00000100:00100000:1.0:1788658609.787122:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788658609.787156:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:18663:x1875544025261952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658609.787556:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:18663:x1875544025261952:12345-0@lo:501:mount.lustre.0 Request processed in 418us (13451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658609.787564:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788658609.792896:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025261952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658609.793160:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658609.793281:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658609.794263:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ea1fe4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788658609.802045:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025262080 00000100:00100000:2.0:1788658609.802062:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025262080 00000100:00100000:2.0:1788658609.802195:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788658609.802208:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:18663:x1875544025262080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658609.804881:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:18663:x1875544025262080:12345-0@lo:503:mount.lustre.0 Request processed in 2666us (11591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658609.804897:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788658609.805071:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788658609.805619:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788658609.805818:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658609.805876:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658609.809068:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ea1fe4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658609.809179:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025262208 00000100:00100000:1.0:1788658609.809189:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025262208 00000100:00100000:1.0:1788658609.812384:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788658609.812415:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:18663:x1875544025262208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658609.813291:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:18663:x1875544025262208:12345-0@lo:502:mount.lustre.0 Request processed in 877us (7410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658609.813303:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788658609.813450:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658609.813811:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788658609.813847:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788658609.813860:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788658609.813873:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788658609.813887:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788658609.813902:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788658609.813927:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788658609.813943:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788658609.813956:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788658609.813967:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788658609.813980:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788658609.814014:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788658609.814057:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658609.814126:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658609.814162:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ea1fe4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658609.814472:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025262336 00000100:00100000:1.0:1788658609.814480:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025262336 00000100:00100000:1.0:1788658609.814517:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788658609.814526:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:18663:x1875544025262336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658609.814659:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:18663:x1875544025262336:12345-0@lo:502:mount.lustre.0 Request processed in 133us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658609.814666:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788658609.815001:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658609.815077:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788658609.815089:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788658609.816183:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788658609.816193:0:18680:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788658609.816200:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658609.816209:0:18680:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788658609.816214:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658609.816230:0:18680:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a1d821b8000) 00000020:00000080:3.0:1788658609.816267:0:18680:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788658609.816275:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788658609.816343:0:18680:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1e88e5d000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788658609.816351:0:18680:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788658609.816358:0:18680:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x48e67cc629c6fc1f 00010000:00010000:3.0:1788658609.828260:0:18680:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788658609.829736:0:18680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1788658609.832514:0:18680:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788658609.846530:0:18680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788658609.846544:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658609.846552:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658609.846554:0:18680:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788658609.846558:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788658609.846561:0:18680:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788658609.846563:0:18680:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788658609.846564:0:18680:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788658609.846565:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788658609.846568:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658609.846570:0:18680:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788658609.846572:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658609.846575:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658609.846576:0:18680:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658609.846579:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658609.846581:0:18680:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788658609.846583:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658609.846585:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658609.846586:0:18680:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788658609.846589:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658609.846599:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658609.846600:0:18680:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788658609.846604:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788658609.846650:0:18680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658609.846653:0:18680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658609.846655:0:18680:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788658609.846658:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788658609.847062:0:18663:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788658609.847093:0:18663:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788658609.847120:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.847133:0:18663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96400/0x48e67cc629c6fc0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc11 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658609.847142:0:18663:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1e88e5d000 from 1 10000000:01000000:3.0:1788658609.847145:0:18663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658609.847188:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.847197:0:18663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.847211:0:18663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658609.847241:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658609.847316:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658609.847358:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ea1fe4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658609.847502:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025262464 00000100:00100000:0.0:1788658609.847510:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025262464 00000100:00100000:0.0:1788658609.847561:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788658609.847571:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:18663:x1875544025262464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658609.847584:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658609.847598:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fc2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fc26 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.847645:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fc2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fc26 expref: 20 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.847657:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fc2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fc26 expref: 20 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.847667:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e81670e00, rc 0) 00000100:00100000:0.0:1788658609.847846:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:18663:x1875544025262464:12345-0@lo:101:mount.lustre.0 Request processed in 275us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658609.847854:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788658609.847949:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658609.847965:0:18663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658609.847976:0:18663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658609.851213:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788658609.851692:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658609.855171:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788658609.855243:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788658609.855273:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788658609.855279:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788658609.855406:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658609.855484:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658609.855538:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb23c59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658609.860781:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025262592 00000100:00100000:1.0:1788658609.860800:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025262592 00000100:00100000:1.0:1788658609.860881:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788658609.860893:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:18663:x1875544025262592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658609.861113:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:18663:x1875544025262592:12345-0@lo:501:mount.lustre.0 Request processed in 221us (5626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658609.861145:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788658609.865875:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658609.866109:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658609.866213:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.866273:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658609.866351:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025262720 00000100:00100000:2.0:1788658609.866359:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025262720 00000100:00100000:2.0:1788658609.866426:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788658609.866437:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:18663:x1875544025262720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658609.866607:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:18663:x1875544025262720:12345-0@lo:503:mount.lustre.0 Request processed in 171us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658609.866615:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788658609.868562:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262720:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788658609.869252:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658609.869349:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658609.870646:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.870720:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504240 going to sleep for 11 seconds 00000100:00100000:1.0:1788658609.871868:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025262848 00000100:00100000:1.0:1788658609.871880:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025262848 00000100:00100000:1.0:1788658609.872177:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788658609.872192:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:18663:x1875544025262848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658609.872778:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:18663:x1875544025262848:12345-0@lo:502:mount.lustre.0 Request processed in 588us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658609.872789:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788658609.872871:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658609.873125:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788658609.873160:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788658609.873176:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788658609.873190:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788658609.873203:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788658609.873215:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788658609.873240:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788658609.873269:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788658609.873286:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788658609.873298:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788658609.873313:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788658609.873353:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658609.873403:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658609.873443:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb23c5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658609.873491:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025262976 00000100:00100000:0.0:1788658609.873498:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025262976 00000100:00100000:0.0:1788658609.873542:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788658609.873551:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:18663:x1875544025262976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658609.873670:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:18663:x1875544025262976:12345-0@lo:502:mount.lustre.0 Request processed in 119us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658609.873686:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788658609.873741:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025262976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658609.873783:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788658609.873790:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788658609.877603:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658609.877623:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658609.877626:0:18684:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788658609.877643:0:18684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1e88e5d000 00000020:00000080:3.0:1788658609.877646:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788658609.877655:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658609.877657:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658609.877659:0:18684:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788658609.877661:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658609.877664:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658609.877666:0:18684:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788658609.877669:0:18684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1e88e5d000 00000020:00000080:3.0:1788658609.877671:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788658609.877752:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658609.877756:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658609.877757:0:18684:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788658609.877760:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658609.877762:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658609.877764:0:18684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788658609.877767:0:18684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1e88e5d000 00000020:00000080:3.0:1788658609.877770:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788658609.877788:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658609.877791:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658609.877792:0:18684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788658609.877795:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658609.877804:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658609.877806:0:18684:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788658609.877810:0:18684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1e88e5d000 00000020:00000080:3.0:1788658609.877812:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788658609.877848:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658609.877851:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658609.877852:0:18684:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788658609.877856:0:18684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788658609.878514:0:18663:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788658609.878550:0:18663:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658609.878583:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.878597:0:18663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658609.878682:0:18663:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788658609.878687:0:18663:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1e88e5d000 10000000:01000000:0.0:1788658609.878691:0:18663:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1e88e5d000 10000000:01000000:0.0:1788658609.878726:0:18663:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658609.878735:0:18663:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1e88e5d000 from 1 10000000:01000000:0.0:1788658609.878738:0:18663:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658609.878790:0:18663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.878799:0:18663:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.878813:0:18663:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658609.886537:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658609.886643:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.886730:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025263104 00000100:00100000:0.0:1788658609.886739:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025263104 00000100:00100000:0.0:1788658609.886794:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788658609.886818:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:18663:x1875544025263104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658609.886837:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658609.886856:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec2045200/0x48e67cc629c6fc3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fc34 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.886887:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec2045200/0x48e67cc629c6fc3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fc34 expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.886900:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec2045200/0x48e67cc629c6fc3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fc34 expref: 21 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.886908:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec2045200, rc 0) 00000100:00100000:0.0:1788658609.888563:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263104:12345-0@lo:101:mount.lustre.0 Request processed in 1738us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658609.888576:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788658609.888658:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658609.888689:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658609.890042:0:18663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.890060:0:18663:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788658609.898606:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788658609.901344:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658609.904604:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788658609.904688:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788658609.904721:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788658609.904737:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788658609.904751:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788658609.904762:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788658609.904773:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788658609.904801:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788658609.904814:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788658609.904825:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788658609.904837:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788658609.904849:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788658609.904859:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788658609.904870:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788658609.904881:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788658609.904892:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788658609.904903:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788658609.904914:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788658609.905501:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788658609.905518:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788658609.905542:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788658609.905554:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788658609.905569:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788658609.905598:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788658609.905614:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788658609.905629:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788658609.905659:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788658609.905672:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788658609.905685:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788658609.905697:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788658609.906539:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788658609.906560:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788658609.906574:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788658609.906590:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788658609.906604:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788658609.906618:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788658609.906643:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788658609.906674:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788658609.906680:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788658609.906836:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658609.907481:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658609.907544:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82bef480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658609.907626:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025263232 00000100:00100000:0.0:1788658609.907646:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025263232 00000100:00100000:0.0:1788658609.907728:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788658609.907738:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658609.907885:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263232:12345-0@lo:501:mount.lustre.0 Request processed in 147us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658609.907900:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788658609.908101:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658609.908146:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658609.908191:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658609.908245:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e82bef480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658609.912141:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025263360 00000100:00100000:0.0:1788658609.912159:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025263360 00000100:00100000:1.0:1788658609.912360:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788658609.912373:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658609.912624:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263360:12345-0@lo:503:mount.lustre.0 Request processed in 252us (4430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658609.912650:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788658609.913286:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263360:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788658609.914026:0:18663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658609.914140:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658609.914207:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.914245:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658609.914311:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025263488 00000100:00100000:1.0:1788658609.914317:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025263488 00000100:00100000:1.0:1788658609.914407:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788658609.914417:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658609.914530:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263488:12345-0@lo:502:mount.lustre.0 Request processed in 114us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658609.914538:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788658609.916345:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658609.919136:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788658609.919177:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788658609.919192:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788658609.919204:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788658609.919217:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788658609.919229:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788658609.919241:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788658609.919270:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788658609.919285:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788658609.919297:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788658609.919310:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788658609.919323:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788658609.919337:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788658609.919347:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788658609.919358:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788658609.919370:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788658609.919382:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788658609.919393:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788658609.920551:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788658609.920575:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788658609.920603:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788658609.920617:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788658609.920631:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788658609.921109:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788658609.921126:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788658609.921138:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788658609.921151:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788658609.921165:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788658609.921177:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788658609.921190:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788658609.921202:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788658609.921214:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788658609.921228:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788658609.921242:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788658609.921256:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788658609.921268:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788658609.921282:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788658609.921294:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788658609.921306:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788658609.921328:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788658609.921341:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788658609.921354:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788658609.921366:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788658609.921378:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788658609.921390:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788658609.921880:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788658609.921905:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788658609.921928:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788658609.921984:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658609.922069:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.922114:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658609.922142:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025263616 00000100:00100000:0.0:1788658609.922156:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025263616 00000100:00100000:0.0:1788658609.922222:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788658609.922231:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658609.922351:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263616:12345-0@lo:502:mount.lustre.0 Request processed in 120us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658609.922358:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788658609.922549:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658609.922808:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788658609.922831:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788658609.922853:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658609.922889:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.922903:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658609.923050:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025263744 00000100:00100000:1.0:1788658609.923056:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025263744 00000100:00100000:1.0:1788658609.923090:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788658609.923100:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658609.923177:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025263744:12345-0@lo:502:mount.lustre.0 Request processed in 79us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658609.923184:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788658609.923590:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025263744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658609.923663:0:18663:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788658609.923672:0:18663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788658609.925233:0:18689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788658609.925254:0:18689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a1e8f254d40) 00000020:00000080:0.0:1788658609.925286:0:18689:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788658609.925478:0:18689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1e88e5d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788658609.925482:0:18689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1e88e5d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788658609.925486:0:18689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1e88e5d000 3 00010000:00080000:0.0:1788658609.925529:0:18689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d832d5000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1788658609.933126:0:18689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788658609.933341:0:18689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788658609.933387:0:18689:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788658609.933401:0:18689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x48e67cc629c6fc49 00000100:00080000:0.0:1788658609.933413:0:18689:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658609.933425:0:18689:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a1d832d5000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658609.933462:0:18689:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83799500 x1875544025263872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658609.933514:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025263872:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788658609.933589:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.933669:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025263872 00000100:00100000:0.0:1788658609.933676:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025263872 00000100:00100000:0.0:1788658609.933730:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658609.933737:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025263872:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788658609.933760:0:17163:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:0.0:1788658609.933798:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x48e67cc629c6fc50 00000004:00100000:0.0:1788658609.933812:0:17163:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788658609.933842:0:17163:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658609.933886:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875544025263872:12345-0@lo:38:llog_process_th.0 Request processed in 148us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658609.933894:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788658609.933945:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d83799500 x1875544025263872/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658609.933954:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788658609.933963:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788658609.933970:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788658609.933975:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788658609.933977:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788658609.933982:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875544025263872:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788658609.933998:0:18689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788658609.934042:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658609.934046:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658609.934049:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658609.934052:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658609.934076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658609.934079:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658609.934081:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658609.934084:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788658609.934107:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025264128:0@lo:400:kworker.0 00000100:00100000:0.0:1788658609.934133:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.934152:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658609.934158:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025264256:0@lo:400:kworker.0 00000100:00100000:0.0:1788658609.934180:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658609.934956:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025264384:0@lo:400:kworker.0 00000100:00100000:3.0:1788658609.934996:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658609.935025:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658609.935031:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025264000:0@lo:400:kworker.0 00000100:00100000:3.0:1788658609.935054:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658609.935094:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025264256 00000100:00100000:3.0:1788658609.935100:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025264256 00000100:00100000:3.0:1788658609.935127:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025264000 00000100:00100000:3.0:1788658609.935130:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025264000 00000100:00100000:3.0:1788658609.935143:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658609.935150:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025264256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658609.935201:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025264256:12345-0@lo:400:kworker.0 Request processed in 51us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658609.935208:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658609.935224:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658609.935230:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025264000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658609.935260:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025264000:12345-0@lo:400:kworker.0 Request processed in 30us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658609.935267:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658609.935301:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025264000:0@lo:400:kworker.0 00000100:00100000:3.0:1788658609.935358:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025264256:0@lo:400:kworker.0 00000100:00100000:3.0:1788658609.935378:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025264128 00000100:00100000:3.0:1788658609.935381:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025264128 00000100:00100000:2.0:1788658609.935554:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025264384 00000100:00100000:3.0:1788658609.935557:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658609.935559:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025264384 00000100:00100000:3.0:1788658609.935564:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025264128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658609.935578:0:17162:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788658609.935586:0:17162:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788658609.935600:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025264128:12345-0@lo:400:kworker.0 Request processed in 37us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658609.935606:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658609.935617:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658609.935622:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025264384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658609.935664:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025264384:12345-0@lo:400:kworker.0 Request processed in 41us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658609.935669:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788658609.935698:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d83798000 x1875544025264384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658609.935735:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025264384:0@lo:400:kworker.0 00010000:00080000:3.0:1788658609.935761:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d8379ad80 x1875544025264128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658609.935770:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025264128:0@lo:400:kworker.0 00000020:01000004:0.0:1788658609.941663:0:18689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788658609.941691:0:18689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8a1e8f250000) 00000020:00000080:0.0:1788658609.941746:0:18689:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788658609.941843:0:18689:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1e88e5d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788658609.941848:0:18689:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1e88e5d000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788658609.941850:0:18689:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1e88e5d000 3 00010000:00080000:0.0:1788658609.941886:0:18689:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d832d3000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.153@tcp at head 00010000:00010000:0.0:1788658609.947663:0:18689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788658609.948545:0:18689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788658609.948591:0:18689:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788658609.948606:0:18689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x48e67cc629c6fc5e 00000100:00080000:0.0:1788658609.948617:0:18689:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658609.948632:0:18689:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8a1d832d3000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658609.948681:0:18689:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83799f80 x1875544025264512/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658609.949596:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875544025264512:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788658609.949684:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788658609.949909:0:18689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788658609.949941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658609.949946:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658609.949948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658609.949951:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658609.949955:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658609.949958:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658609.949961:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658609.949964:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788658609.950837:0:18689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788658609.950954:0:18663:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788658609.950986:0:18663:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788658609.951011:0:18663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658609.951022:0:18663:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045400/0x48e67cc629c6fc34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc3b expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788658609.951067:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788658609.951069:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788658609.951071:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658609.951072:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658609.951073:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658609.951078:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658609.951079:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658609.951081:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658609.951082:0:18663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788658609.951086:0:18663:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788658609.951088:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788658609.951089:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788658609.951090:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658609.951091:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658609.951092:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658609.951093:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658609.951094:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658609.951095:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658609.951095:0:18663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788658609.951118:0:18663:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788658609.951135:0:18663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025264640:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788658609.951186:0:18663:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658609.951216:0:18663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83158180 going to sleep for 11 seconds 00000100:00100000:1.0:1788658609.951238:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025264640 00000100:00100000:1.0:1788658609.951245:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025264640 00000100:00100000:1.0:1788658609.951282:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788658609.951292:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025264640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788658609.951317:0:17156:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788658609.951333:0:17156:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788658609.951778:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025264512 00000100:00100000:2.0:1788658609.951785:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025264512 00000100:00100000:2.0:1788658609.951811:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658609.951818:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025264512:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788658609.951842:0:17163:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:2.0:1788658609.951891:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x48e67cc629c6fc65 00000004:00100000:2.0:1788658609.951906:0:17163:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788658609.951956:0:17163:0:(import.c:65:import_set_state_nolock()) ffff8a1eabc57800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658609.952012:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875544025264512:12345-0@lo:38:llog_process_th.0 Request processed in 193us (2328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658609.952019:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788658609.952063:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a1d83799f80 x1875544025264512/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658609.952085:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658609.952093:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788658609.952100:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788658609.952104:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788658609.952106:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658609.952112:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875544025264512:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788658609.960851:0:17156:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788658609.960876:0:17156:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788658609.961192:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:18663:x1875544025264640:12345-0@lo:253:mount.lustre.0 Request processed in 9896us (9999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658609.961205:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 20000000:01000000:0.0:1788658609.961276:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788658609.961282:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788658609.961303:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.961320:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6fbb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fbaf expref: 20 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.961327:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fbc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fbbd expref: 20 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.961349:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.961388:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fbbd expref: 20 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.961477:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fbc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fbbd expref: 20 pid: 17157 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658609.961491:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025264768:0@lo:104: 00000100:00100000:0.0:1788658609.961528:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658609.961574:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6fbb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fbaf expref: 20 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.961585:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6fbb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fbaf expref: 20 pid: 17156 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658609.961592:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025264896:0@lo:104: 00000100:00100000:0.0:1788658609.961615:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.961632:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e862003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658609.961669:0:17145:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788658609.961684:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025264768 00000100:00100000:0.0:1788658609.961690:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025264768 00000100:00100000:0.0:1788658609.961747:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025264896 00000100:00100000:0.0:1788658609.961750:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025264896 00000100:00100000:0.0:1788658609.961762:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658609.961770:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+4:17178:x1875544025264768:12345-0@lo:104: 00010000:00010000:0.0:1788658609.961782:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.961830:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658609.961836:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+4:17178:x1875544025264768:12345-0@lo:104: Request processed in 67us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658609.962102:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658609.962120:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658609.962126:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83639c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:17178:x1875544025264896:12345-0@lo:104: 00010000:00010000:0.0:1788658609.962135:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.962169:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788658609.962174:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83639c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:17178:x1875544025264896:12345-0@lo:104: Request processed in 49us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658609.962179:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788658609.962215:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658609.962221:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.962228:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658609.962232:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.962240:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658609.962247:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658609.962253:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658609.962287:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.962293:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658609.962312:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.962319:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96800/0x48e67cc629c6fbbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbc4 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.962332:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658609.962335:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.962341:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1a00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:0.0:1788658609.962343:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.962350:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658609.962356:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658609.962361:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658609.962370:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.962375:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658609.962387:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658609.963047:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658609.963063:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025265152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658609.963107:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658609.963152:0:18316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025265152 00000100:00100000:2.0:1788658609.963156:0:18316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025265152 00010000:00010000:2.0:1788658609.963178:0:18316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6fbb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fbaf expref: 21 pid: 17156 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658609.963204:0:18316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658609.963212:0:18316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3648:x1875544025265152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658609.963223:0:18316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658609.963228:0:18316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6fbb6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fbaf expref: 21 pid: 17156 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963238:0:18316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6fbb6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fbaf expref: 21 pid: 17156 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963263:0:18316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658609.963294:0:18316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3648:x1875544025265152:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658609.963301:0:18316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658609.963338:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025265152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658609.963492:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1a00/0x48e67cc629c6fbaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbb6 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658609.963511:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.963513:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.963515:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658609.963522:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658609.963533:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025265024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658609.963562:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658609.963615:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025264768:0@lo:104: 00010000:00010000:0.0:1788658609.963626:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6fbb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fbaf expref: 20 pid: 17156 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658609.963645:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025264896:0@lo:104: 00010000:00010000:0.0:1788658609.963662:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658609.963748:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025265024 00000100:00100000:2.0:1788658609.963752:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025265024 00010000:00010000:2.0:1788658609.963766:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fbc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fbbd expref: 20 pid: 17157 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658609.963788:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658609.963794:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eabc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:3650:x1875544025265024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658609.963801:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658609.963806:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fbc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fbbd expref: 20 pid: 17157 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963815:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fbc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fbbd expref: 20 pid: 17157 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963825:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fbc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fbbd expref: 20 pid: 17157 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963836:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963843:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788658609.963856:0:17149:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003888168s 00010000:00010000:2.0:1788658609.963867:0:17149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963874:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963881:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963887:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963891:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2044000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658609.963896:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963903:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.963916:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.964621:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658609.964687:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eabc43c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:3650:x1875544025265024:12345-0@lo:103:ldlm_bl.0 Request processed in 892us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658609.964695:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658609.965462:0:18663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:18663:1875544025264640:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788658609.965478:0:18663:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788658609.965482:0:18663:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788658609.965485:0:18663:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788658609.965486:0:18663:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658609.965487:0:18663:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658609.965490:0:18663:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658609.965491:0:18663:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658609.965493:0:18663:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658609.965495:0:18663:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658609.965497:0:18663:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788658609.965522:0:18663:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788658609.967532:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025265024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658609.968031:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.968044:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658609.968070:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec2044000/0x48e67cc629c6fc6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788658609.972645:0:18663:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788658609.977648:0:18663:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788658609.977659:0:18663:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788658609.977886:0:18663:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788658609.977949:0:18663:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788658609.977970:0:18663:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788658609.977998:0:18663:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788658609.978857:0:18663:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658609.979125:0:18663:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788658610.239870:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658610.820540:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788658611.111513:0:18745:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658611.112211:0:18745:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788658611.274110:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788658611.710973:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788658611.710984:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1e82c42000 from 9 10000000:01000000:2.0:1788658611.711000:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658611.711053:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658611.711065:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658611.711077:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658611.711104:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025265280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658611.711174:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658611.711229:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658611.711363:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025265280 00000100:00100000:0.0:1788658611.711371:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025265280 00000100:00100000:0.0:1788658611.711430:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788658611.711440:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+19:17159:x1875544025265280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658611.711454:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658611.711469:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec2045600/0x48e67cc629c6fc7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fc73 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658611.711497:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec2045600/0x48e67cc629c6fc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fc73 expref: 20 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658611.711508:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec2045600/0x48e67cc629c6fc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fc73 expref: 20 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658611.711517:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec2045600, rc 0) 00000100:00100000:0.0:1788658611.711567:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:17159:x1875544025265280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658611.711573:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788658611.711823:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025265280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658611.711942:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658611.711953:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658611.712080:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025265408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788658611.712127:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658611.712155:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658611.712211:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025265408 00000100:00100000:0.0:1788658611.712216:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025265408 00000100:00100000:0.0:1788658611.712564:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788658611.712573:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:17159:x1875544025265408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788658611.712591:0:17156:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788658611.712617:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788658611.712620:0:17156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788658611.712753:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:17159:x1875544025265408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 180us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658611.712761:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788658611.712860:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025265408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788658611.712928:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658611.712936:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658611.712956:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658611.712966:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658611.712968:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1eb751f000 from 9 10000000:01000000:3.0:1788658611.712971:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658611.713006:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658611.713014:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658611.713023:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658611.713038:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025265536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658611.713068:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658611.713465:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ea1fe4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658611.718769:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025265536 00000100:00100000:1.0:1788658611.718788:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025265536 00000100:00100000:1.0:1788658611.719329:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788658611.719344:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:17159:x1875544025265536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658611.719363:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658611.719383:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83419200/0x48e67cc629c6fc88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fc81 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658611.719413:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83419200/0x48e67cc629c6fc88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fc81 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658611.719426:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83419200/0x48e67cc629c6fc88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fc81 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658611.719435:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419200, rc 0) 00000100:00100000:1.0:1788658611.719737:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:17159:x1875544025265536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 363us (6632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658611.719745:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788658611.719822:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025265536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658611.719844:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658611.719854:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658611.720835:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025265664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788658611.721371:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658611.722345:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e9813f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658611.722979:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025265664 00000100:00100000:0.0:1788658611.723009:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025265664 00000100:00100000:0.0:1788658611.723093:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788658611.723104:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:17159:x1875544025265664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788658611.723131:0:17157:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788658611.723149:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788658611.723152:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788658611.723273:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:17159:x1875544025265664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 170us (1902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658611.723281:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788658611.729444:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025265664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788658611.729548:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658611.729559:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658611.729569:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658612.287863:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658612.670853:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658612.670866:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025265920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788658612.670869:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025265792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658612.672356:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658612.672417:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025265792 00000100:00100000:0.0:1788658612.672425:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025265792 00000100:00100000:0.0:1788658612.672477:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658612.672486:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025265792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658612.672524:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788658612.672568:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025265792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658612.672575:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658612.672624:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025265792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658612.673963:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658612.674145:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025265920 00000100:00100000:3.0:1788658612.674152:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025265920 00000100:00100000:3.0:1788658612.674193:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658612.674202:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025265920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658612.674229:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788658612.674271:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025265920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658612.674277:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658612.674339:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025265920:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788658613.317303:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658614.334935:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788658614.531604:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1788658615.231017:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658615.231024:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658615.231027:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658615.231030:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658615.231044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658615.231053:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788658615.231056:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658615.231059:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788658615.231436:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025266176:0@lo:400:kworker.0 00000100:00100000:0.0:1788658615.231500:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658615.231542:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025266688:0@lo:400:kworker.0 00000100:00100000:0.0:1788658615.231561:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658615.231589:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788658615.231595:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025266304:0@lo:400:kworker.0 00000100:00100000:0.0:1788658615.231614:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658615.231627:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025266816:0@lo:400:kworker.0 00000100:00100000:0.0:1788658615.231645:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658615.231675:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025266176 00000100:00100000:0.0:1788658615.231681:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025266176 00000100:00100000:0.0:1788658615.231739:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788658615.231747:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025266176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.231851:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025266048:0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.231901:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658615.231928:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025266560:0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.231946:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658615.231962:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658615.231966:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025266432:0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.231982:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658615.232006:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025266688 00000100:00100000:3.0:1788658615.232009:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025266688 00000100:00100000:3.0:1788658615.232037:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025266304 00000100:00100000:3.0:1788658615.232039:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025266304 00000100:00100000:3.0:1788658615.232049:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025266816 00000100:00100000:3.0:1788658615.232051:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025266816 00000100:00100000:3.0:1788658615.232062:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025266560 00000100:00100000:3.0:1788658615.232063:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025266560 00000100:00100000:3.0:1788658615.232073:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658615.232079:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025266688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.232122:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025266688:12345-0@lo:400:kworker.0 Request processed in 43us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658615.232129:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658615.232142:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658615.232147:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025266304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.232167:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025266304:12345-0@lo:400:kworker.0 Request processed in 20us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658615.232172:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658615.232180:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658615.232184:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025266816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.232202:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025266816:12345-0@lo:400:kworker.0 Request processed in 18us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658615.232312:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658615.232320:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025266560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658615.232354:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025266560:12345-0@lo:400:kworker.0 Request processed in 36us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658615.232360:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788658615.232385:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658615.232388:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658615.232849:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658615.232885:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025266048 00000100:00100000:3.0:1788658615.232890:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025266048 00000100:00100000:3.0:1788658615.232919:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788658615.232926:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3650:x1875544025266048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.232963:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3650:x1875544025266048:12345-0@lo:400:kworker.0 Request processed in 38us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658615.232969:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788658615.233004:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025266432 00000100:00100000:3.0:1788658615.233008:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025266432 00000100:00100000:3.0:1788658615.233025:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658615.233030:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025266432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.233059:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025266432:12345-0@lo:400:kworker.0 Request processed in 29us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658615.233065:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658615.233104:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025266432:0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.233114:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025266048:0@lo:400:kworker.0 00010000:00080000:3.0:1788658615.233127:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83799500 x1875544025266560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658615.233136:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83799500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025266560:0@lo:400:kworker.0 00010000:00080000:3.0:1788658615.233170:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83798000 x1875544025266304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658615.233178:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025266304:0@lo:400:kworker.0 00010000:00080000:3.0:1788658615.233196:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83798e00 x1875544025266816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658615.234342:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025266176:12345-0@lo:400:kworker.0 Request processed in 2590us (2836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658615.234353:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658615.234851:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83798e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025266816:0@lo:400:kworker.0 00000100:00100000:3.0:1788658615.234889:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025266176:0@lo:400:kworker.0 00010000:00080000:3.0:1788658615.234908:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d8379a300 x1875544025266688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658615.234917:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025266688:0@lo:400:kworker.0 00010000:00010000:0.0:1788658615.361689:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658616.127817:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658601/real 1788658601] req@ffff8a1eb7402d80 x1875544025258240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658616.127847:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1eb7402d80 x1875544025258240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658616.127857:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658601/real 1788658601] req@ffff8a1eb7403800 x1875544025258368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658616.127869:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1eb7403800 x1875544025258368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658616.127889:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb744b000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658616.127932:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788658616.127936:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025258240:0@lo:8:kworker.0 00000100:00080000:2.0:1788658616.127950:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658616.127956:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788658616.127959:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7403800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025258368:0@lo:8:kworker.0 00000100:00100000:2.0:1788658616.128112:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025266944:0@lo:400:kworker.0 00000100:00100000:2.0:1788658616.128179:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658616.129243:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025266944 00000100:00100000:3.0:1788658616.129253:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025266944 00000100:00100000:3.0:1788658616.129305:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788658616.129315:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3649:x1875544025266944:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788658616.133113:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658616.133122:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658616.133125:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658616.133128:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658616.133177:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658616.133180:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788658616.133183:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1eb744b000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658616.133191:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 518 00000100:00080000:1.0:1788658616.133198:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788658616.133205:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8a1eb744b000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658616.133228:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f2d80 x1875544025267456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658616.133257:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658616.133260:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788658616.133262:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658616.133265:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 518 00000100:00080000:1.0:1788658616.133268:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788658616.133271:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ec1295800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658616.133285:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f0700 x1875544025267584/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658616.133352:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025267072:0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.133423:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658616.133458:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025267840:0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.133487:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658616.133509:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658616.133514:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025267712:0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.133539:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658616.133563:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025267200:0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.133585:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658616.133601:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025267968:0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.133622:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658616.133638:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658616.134768:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025267328:0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.134819:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658616.134877:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025267072 00000100:00100000:1.0:1788658616.134885:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025267072 00000100:00100000:1.0:1788658616.134948:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025267328 00000100:00100000:1.0:1788658616.134952:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025267328 00000100:00100000:1.0:1788658616.134968:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658616.134975:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025267072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.135037:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025267072:12345-0@lo:400:kworker.0 Request processed in 61us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658616.135044:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658616.135062:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658616.135068:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025267328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.135100:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025267328:12345-0@lo:400:kworker.0 Request processed in 33us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658616.135106:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788658616.135124:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025267840 00000100:00100000:1.0:1788658616.135129:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025267840 00000100:00100000:1.0:1788658616.135148:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025267712 00000100:00100000:1.0:1788658616.135151:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025267712 00000100:00100000:1.0:1788658616.135162:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025267200 00000100:00100000:1.0:1788658616.135165:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025267200 00000100:00100000:1.0:1788658616.135174:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025267968 00000100:00100000:1.0:1788658616.135177:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025267968 00000100:00100000:1.0:1788658616.135189:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658616.135194:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025267840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.135224:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025267840:12345-0@lo:400:kworker.0 Request processed in 29us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658616.135229:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658616.135241:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658616.135246:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025267712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.135272:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025267712:12345-0@lo:400:kworker.0 Request processed in 26us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658616.135285:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658616.135297:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658616.135303:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025267200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.135330:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025267200:12345-0@lo:400:kworker.0 Request processed in 27us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658616.135335:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658616.135345:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658616.135351:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025267968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658616.135376:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025267968:12345-0@lo:400:kworker.0 Request processed in 25us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658616.135381:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658616.135428:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025267456:0@lo:8:kworker.0 00000100:00100000:1.0:1788658616.135456:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658616.135488:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025267584:0@lo:8:kworker.0 00000100:00100000:1.0:1788658616.135509:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658616.135544:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025267456 00000100:00100000:1.0:1788658616.135548:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025267456 00000100:00100000:1.0:1788658616.135561:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025267584 00000100:00100000:1.0:1788658616.135564:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025267584 00000100:00100000:1.0:1788658616.135573:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658616.135577:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875544025267456:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788658616.135603:0:18669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1788658616.135635:0:18669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6fc8f 00002000:00100000:1.0:1788658616.135656:0:18669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8a1d8266d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788658616.135661:0:18669:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788658616.135669:0:18669:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788658616.135849:0:18669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788658616.135870:0:18669:0:(import.c:65:import_set_state_nolock()) ffff8a1d8266b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658616.135919:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875544025267456:12345-0@lo:8:kworker.0 Request processed in 339us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658616.135926:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658616.135944:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658616.135947:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875544025267584:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788658616.135959:0:18669:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788658616.136110:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3649:x1875544025266944:12345-0@lo:400:kworker.0 Request processed in 6794us (7928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658616.136120:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788658616.136288:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025266944:0@lo:400:kworker.0 00010000:00080000:2.0:1788658616.136903:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d834f1180 x1875544025267712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658616.136920:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025267712:0@lo:400:kworker.0 00000100:00100000:2.0:1788658616.136934:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025267072:0@lo:400:kworker.0 00010000:00080000:2.0:1788658616.136951:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d834f3b80 x1875544025267840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658616.136959:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025267840:0@lo:400:kworker.0 00000100:00100000:0.0:1788658616.137808:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025267328:0@lo:400:kworker.0 00010000:00080000:0.0:1788658616.137824:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d834f0a80 x1875544025267200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658616.137833:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025267200:0@lo:400:kworker.0 00010000:00080000:0.0:1788658616.137852:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d834f0380 x1875544025267968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658616.137859:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025267968:0@lo:400:kworker.0 00010000:00080000:1.0:1788658616.149642:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d834f2d80 x1875544025267456/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658616.149776:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658616.149787:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788658616.149797:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788658616.149804:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788658616.149807:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb744b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788658616.149832:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788658616.149840:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025267456:0@lo:8:kworker.0 00000100:00100000:1.0:1788658616.151545:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875544025267584:12345-0@lo:8:kworker.0 Request processed in 15587us (16026us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788658616.151561:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788658616.151614:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658616.151619:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788658616.151623:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025267584:0@lo:8:kworker.0 00000004:00080000:3.0:1788658616.154867:0:17903:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788658616.154916:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875544025268224:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788658616.154995:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658616.155026:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2168240 going to sleep for 11 seconds 00000004:00080000:3.0:1788658616.155045:0:17902:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788658616.155047:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025268224 00000100:00100000:1.0:1788658616.155056:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025268224 00000100:00100000:1.0:1788658616.155126:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658616.155137:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17903:x1875544025268224:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788658616.155149:0:17902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 533371446149ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788658616.155155:0:17902:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788658616.155179:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658616.155189:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025268096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658616.155219:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658616.155404:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025268096 00000100:00100000:3.0:1788658616.155408:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025268096 00000100:00100000:3.0:1788658616.155440:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658616.155446:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875544025268096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658616.155465:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788658616.155509:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875544025268096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658616.155516:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788658616.155555:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb9ad80 x1875544025268096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658616.155573:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025268096:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1788658616.156484:0:17894:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788658616.159958:0:18667:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788658616.159967:0:18667:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788658616.160069:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17903:x1875544025268224:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4929us (5069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658616.160080:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788658616.160244:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb99c00 x1875544025268224/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788658632 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658616.160259:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875544025268224:0@lo:7:osp-pre-0-1.0 00000100:00080000:2.0:1788658616.160661:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788658616.161540:0:17903:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788658616.161604:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875544025268352:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788658616.161686:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658616.161739:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb2168240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658616.161757:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025268352 00000100:00100000:2.0:1788658616.161766:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025268352 00000100:00100000:2.0:1788658616.161834:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658616.161844:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17903:x1875544025268352:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788658616.161875:0:18669:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788658616.161935:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17903:x1875544025268352:12345-0@lo:5:osp-pre-0-1.0 Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658616.161942:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788658616.162365:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb99c00 x1875544025268352/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658632 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658616.162380:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb99c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875544025268352:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788658616.162394:0:17903:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788658616.162426:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875544025268480:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788658616.162454:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658616.162484:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e87dada80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658616.162547:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025268480 00000100:00100000:2.0:1788658616.162558:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025268480 00000100:00100000:2.0:1788658616.162593:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658616.162599:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17903:x1875544025268480:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788658616.162634:0:18667:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1788658616.181724:0:18664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788658616.181745:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788658616.182001:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17903:x1875544025268480:12345-0@lo:5:osp-pre-0-1.0 Request processed in 19396us (19540us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788658616.182012:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788658616.182055:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb7400000 x1875544025268480/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658632 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658616.182068:0:17903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788658616.182074:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17903:1875544025268480:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788658616.182090:0:17903:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788658616.182144:0:17903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17903:1875544025268608:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788658616.182177:0:17903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658616.182208:0:17903:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e87dada80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658616.182277:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025268608 00000100:00100000:3.0:1788658616.182284:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025268608 00000100:00100000:3.0:1788658616.182339:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658616.182349:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1875544025268608:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788658616.182410:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1875544025268608:12345-0@lo:900:osp-pre-0-1.0 Request processed in 63us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658616.182431:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788658616.182507:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb7400000 x1875544025268608/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788658632 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658616.182516:0:17903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17903:1875544025268608:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788658616.384845:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658616.442389:0:19034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788658617.419024:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788658617.448578:0:19086:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658617.449040:0:19086:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788658617.791182:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025268736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658617.791266:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658617.791371:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025268736 00000100:00100000:0.0:1788658617.791382:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025268736 00000100:00100000:0.0:1788658617.791538:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788658617.791550:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025268736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658617.791612:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788658617.794055:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025268736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2500us (2782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658617.794070:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025268736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658617.794070:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658617.794098:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658617.794109:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025268864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658617.794166:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658617.796428:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025268864 00000100:00100000:2.0:1788658617.796448:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025268864 00000100:00100000:2.0:1788658617.796519:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788658617.796529:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025268864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788658617.796567:0:18107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788658617.796722:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025268864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 194us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658617.796729:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658617.797026:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025268864:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788658618.337230:0:19137:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658618.337552:0:19137:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788658618.431881:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658619.456433:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788658620.031532:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788658620.483204:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658621.375270:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658621.375277:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658621.375280:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658621.375283:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788658621.375312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658621.375315:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788658621.375319:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658621.375328:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 533 00000100:00080000:1.0:1788658621.375334:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788658621.375351:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ec1295800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:1.0:1788658621.375377:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83d50000 x1875544025269632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658621.375443:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025269120:0@lo:400:kworker.0 00000100:00100000:1.0:1788658621.375511:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658621.375564:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025269760:0@lo:400:kworker.0 00000100:00100000:1.0:1788658621.375589:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658621.375615:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788658621.375622:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025268992:0@lo:400:kworker.0 00000100:00100000:1.0:1788658621.375653:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658621.375678:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025269504:0@lo:400:kworker.0 00000100:00100000:1.0:1788658621.375732:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658621.375760:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025269248:0@lo:400:kworker.0 00000100:00100000:1.0:1788658621.375785:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658621.375803:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025269888:0@lo:400:kworker.0 00000100:00100000:1.0:1788658621.375823:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658621.376605:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658621.376617:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025270144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658621.376651:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658621.376688:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025270144 00000100:00100000:0.0:1788658621.376695:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025270144 00000100:00100000:0.0:1788658621.376768:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658621.376777:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025270144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658621.376808:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788658621.376955:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658621.377611:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025269504 00000100:00100000:2.0:1788658621.377619:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025269504 00000100:00100000:2.0:1788658621.377662:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658621.377672:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1875544025269504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658621.377754:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3648:x1875544025269504:12345-0@lo:400:kworker.0 Request processed in 84us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658621.377762:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658621.377785:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025268992 00000100:00100000:2.0:1788658621.377789:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025268992 00000100:00100000:2.0:1788658621.377816:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788658621.377822:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3648:x1875544025268992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658621.378064:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7403800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025270144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1287us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658621.378072:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788658621.378123:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb7400000 x1875544025270144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658621.378143:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025270144:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788658621.378156:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83d50e00 x1875544025269504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658621.378164:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025269504:0@lo:400:kworker.0 00000100:00100000:2.0:1788658621.378320:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3648:x1875544025268992:12345-0@lo:400:kworker.0 Request processed in 497us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658621.378776:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025269632:0@lo:8:kworker.0 00000100:00100000:3.0:1788658621.378828:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658621.378891:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025269120 00000100:00100000:3.0:1788658621.378897:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025269120 00000100:00100000:3.0:1788658621.378932:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788658621.378938:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025269120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658621.378988:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025269120:12345-0@lo:400:kworker.0 Request processed in 51us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658621.378995:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788658621.379013:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025269760 00000100:00100000:3.0:1788658621.379017:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025269760 00000100:00100000:3.0:1788658621.379047:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025269248 00000100:00100000:3.0:1788658621.379050:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025269248 00000100:00100000:3.0:1788658621.379060:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025269888 00000100:00100000:3.0:1788658621.379062:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025269888 00000100:00100000:3.0:1788658621.379083:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788658621.379088:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025269760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658621.379117:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025269760:12345-0@lo:400:kworker.0 Request processed in 29us (3528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658621.379123:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788658621.379133:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658621.379138:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025269248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658621.379163:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025269248:12345-0@lo:400:kworker.0 Request processed in 25us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658621.379168:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658621.379177:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658621.379182:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025269888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658621.379238:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875544025269888:12345-0@lo:400:kworker.0 Request processed in 42us (3400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658621.379243:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788658621.379380:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788658621.379415:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025269376:0@lo:400:kworker.0 00000100:00100000:2.0:1788658621.379442:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658621.379473:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025270016:0@lo:400:kworker.0 00000100:00100000:2.0:1788658621.379496:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658621.379529:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025269376 00000100:00100000:2.0:1788658621.379533:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025269376 00000100:00100000:2.0:1788658621.379557:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658621.379564:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025269376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658621.379598:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025269376:12345-0@lo:400:kworker.0 Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658621.379604:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788658621.379619:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025270016 00000100:00100000:2.0:1788658621.379622:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025270016 00000100:00100000:2.0:1788658621.379639:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788658621.379646:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025270016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658621.379676:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025270016:12345-0@lo:400:kworker.0 Request processed in 30us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658621.379681:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788658621.379727:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025269376:0@lo:400:kworker.0 00010000:00080000:2.0:1788658621.379739:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83d53b80 x1875544025270016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658621.379749:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025270016:0@lo:400:kworker.0 00000100:00080000:2.0:1788658621.379767:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658621.379777:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788658621.379934:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83d50700 x1875544025269248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658621.379955:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025269248:0@lo:400:kworker.0 00010000:00080000:1.0:1788658621.379968:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83d53480 x1875544025269888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658621.379978:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875544025269888:0@lo:400:kworker.0 00000100:00100000:1.0:1788658621.380007:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025269632 00000100:00100000:1.0:1788658621.380011:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025269632 00000100:00100000:1.0:1788658621.380035:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658621.380040:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875544025269632:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788658621.380066:0:18667:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788658621.382081:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025268992:0@lo:400:kworker.0 00000100:00100000:0.0:1788658621.382102:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025269120:0@lo:400:kworker.0 00010000:00080000:0.0:1788658621.382134:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83d53800 x1875544025269760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658621.382145:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025269760:0@lo:400:kworker.0 00000100:00100000:1.0:1788658621.390574:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875544025269632:12345-0@lo:8:kworker.0 Request processed in 10523us (11736us total) trans 0 rc -19/-19 00000100:00080000:3.0:1788658621.390598:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658621.390605:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788658621.390609:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025269632:0@lo:8:kworker.0 00000100:00100000:1.0:1788658621.395052:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788658621.504761:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658622.401125:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658602/real 1788658602] req@ffff8a1eb7400e00 x1875544025259264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658622 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658622.401156:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1eb7400e00 x1875544025259264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658622 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658622.401167:0:3646:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658602/real 1788658602] req@ffff8a1eb7402a00 x1875544025259392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658622 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658622.401191:0:3646:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a1eb7402a00 x1875544025259392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658622 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788658622.401212:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3234000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658622.409104:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788658622.409119:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025259264:0@lo:8:kworker.0 00000100:00080000:0.0:1788658622.409132:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788658622.409141:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788658622.409144:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7402a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025259392:0@lo:8:kworker.0 00000100:00080000:2.0:1788658622.411941:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658622.411949:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788658622.411954:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3234000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658622.411964:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788658622.411971:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788658622.411978:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a1eb3234000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658622.412005:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83c22d80 x1875544025270528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658622.412020:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658622.412023:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788658622.412025:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658622.412027:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:2.0:1788658622.412030:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788658622.412032:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1eb3235800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658622.412044:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83c21f80 x1875544025270656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658622.412148:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025270272:0@lo:400:kworker.0 00000100:00100000:0.0:1788658622.412238:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658622.412300:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025270528:0@lo:8:kworker.0 00000100:00100000:0.0:1788658622.412330:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658622.412382:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025270528 00000100:00100000:0.0:1788658622.412389:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025270528 00000100:00100000:0.0:1788658622.412425:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658622.412432:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875544025270528:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788658622.412461:0:18669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:0.0:1788658622.412492:0:18669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6fc96 00002000:00100000:0.0:1788658622.412506:0:18669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a1d832d4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788658622.412511:0:18669:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788658622.412513:0:18669:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788658622.412593:0:18669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788658622.412614:0:18669:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658622.412673:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875544025270528:12345-0@lo:8:kworker.0 Request processed in 240us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658622.412681:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788658622.412751:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83c22d80 x1875544025270528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658622.412762:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788658622.412771:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788658622.412779:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788658622.412784:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788658622.412785:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3234000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788658622.412801:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788658622.412806:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025270528:0@lo:8:kworker.0 00000004:00080000:0.0:1788658622.412847:0:17187:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788658622.412863:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1875544025270912:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788658622.412899:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658622.412926:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260b40 going to sleep for 11 seconds 00000004:00080000:0.0:1788658622.412941:0:17186:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788658622.413005:0:17186:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 539629301182ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788658622.413011:0:17186:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788658622.413034:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025270912 00000100:00100000:0.0:1788658622.413039:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025270912 00000100:00100000:0.0:1788658622.413089:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658622.413096:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17187:x1875544025270912:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788658622.413406:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658622.413442:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025270400:0@lo:400:kworker.0 00000100:00100000:0.0:1788658622.413472:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658622.413492:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658622.413497:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025270784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658622.413517:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658622.413539:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025270400 00000100:00100000:0.0:1788658622.413542:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025270400 00000100:00100000:0.0:1788658622.413569:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788658622.413574:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025270400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658622.413672:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025270400:12345-0@lo:400:kworker.0 Request processed in 97us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658622.413680:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788658622.413730:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025270784 00000100:00100000:0.0:1788658622.413734:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025270784 00000100:00100000:0.0:1788658622.413758:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658622.413765:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875544025270784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658622.413778:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788658622.413808:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875544025270784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658622.413825:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788658622.414010:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb7400e00 x1875544025270784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658622.414031:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025270784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788658622.414059:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025270400:0@lo:400:kworker.0 00000100:00100000:3.0:1788658622.415397:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025270272 00000100:00100000:3.0:1788658622.415412:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025270272 00000100:00100000:3.0:1788658622.415465:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788658622.415475:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3648:x1875544025270272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658622.415569:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:3648:x1875544025270272:12345-0@lo:400:kworker.0 Request processed in 96us (3330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.415577:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788658622.415633:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:913293d7-fe00-4834-a4c1-1b0cae17d59a:3648:1875544025270272:0@lo:400:kworker.0 00000100:00080000:2.0:1788658622.416878:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658622.416883:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788658622.416886:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658622.416894:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 538 00000100:00080000:2.0:1788658622.416898:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788658622.416905:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ec1295800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658622.416934:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d834f0700 x1875544025271424/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658622.417011:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025271040:0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.417089:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658622.417125:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025271680:0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.417147:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658622.417171:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788658622.417313:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025271168:0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.417341:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658622.417361:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025271808:0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.417382:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658622.417412:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025271552:0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.417439:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658622.417459:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658622.417464:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025271296:0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.417492:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658622.417521:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025271040 00000100:00100000:2.0:1788658622.417529:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025271040 00000100:00100000:2.0:1788658622.417580:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025271680 00000100:00100000:2.0:1788658622.417583:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025271680 00000100:00100000:2.0:1788658622.417595:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025271808 00000100:00100000:2.0:1788658622.417597:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025271808 00000100:00100000:2.0:1788658622.417608:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025271552 00000100:00100000:2.0:1788658622.417609:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025271552 00000100:00100000:2.0:1788658622.417623:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788658622.417632:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025271040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.417815:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025271040:12345-0@lo:400:kworker.0 Request processed in 183us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658622.417834:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788658622.417852:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658622.417858:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025271680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.417902:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025271680:12345-0@lo:400:kworker.0 Request processed in 44us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658622.417909:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658622.417924:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788658622.417932:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025271808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.417963:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025271808:12345-0@lo:400:kworker.0 Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658622.417970:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788658622.417983:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788658622.417990:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025271552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.418028:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025271552:12345-0@lo:400:kworker.0 Request processed in 39us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658622.418034:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658622.418230:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025271168 00000100:00100000:3.0:1788658622.418236:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025271168 00000100:00100000:3.0:1788658622.418277:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788658622.418284:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025271168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658622.418324:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025271168:12345-0@lo:400:kworker.0 Request processed in 41us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.418330:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788658622.418362:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025270656:0@lo:8:kworker.0 00000100:00100000:3.0:1788658622.418402:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658622.418435:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025271424:0@lo:8:kworker.0 00000100:00100000:3.0:1788658622.418457:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658622.418488:0:18669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788658622.418496:0:18669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788658622.418626:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025271296 00000100:00100000:3.0:1788658622.418630:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025271296 00000100:00100000:3.0:1788658622.418665:0:18669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788658622.418670:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025270656 00000100:00100000:3.0:1788658622.418674:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025270656 00000100:00100000:3.0:1788658622.418683:0:18669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788658622.418686:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025271424 00000100:00100000:3.0:1788658622.418689:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025271424 00000100:00100000:3.0:1788658622.418696:0:18669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788658622.418742:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658622.418748:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025271296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658622.418797:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025271296:12345-0@lo:400:kworker.0 Request processed in 49us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.418804:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658622.418913:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658622.418918:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025270656:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788658622.418945:0:19325:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788658622.418983:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025270656:12345-0@lo:8:kworker.0 Request processed in 64us (580us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788658622.418990:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788658622.419031:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658622.419039:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788658622.419043:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025270656:0@lo:8:kworker.0 00010000:00080000:2.0:1788658622.419783:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83c22d80 x1875544025271296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788658638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658622.419804:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025271296:0@lo:400:kworker.0 00010000:00080000:2.0:1788658622.419820:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d834f2d80 x1875544025271552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658622.419829:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025271552:0@lo:400:kworker.0 00000100:00100000:2.0:1788658622.419902:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025271168:0@lo:400:kworker.0 00010000:00080000:2.0:1788658622.419929:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d834f0a80 x1875544025271808/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658622.419939:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025271808:0@lo:400:kworker.0 00010000:00080000:2.0:1788658622.419952:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83c20700 x1875544025271040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658622.419960:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025271040:0@lo:400:kworker.0 00010000:00080000:2.0:1788658622.419972:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d834f0380 x1875544025271680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658622.419980:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025271680:0@lo:400:kworker.0 00000100:00100000:3.0:1788658622.420110:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658622.420117:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025271424:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788658622.420137:0:19325:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788658622.420364:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025271424:12345-0@lo:8:kworker.0 Request processed in 246us (1904us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788658622.420372:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788658622.420404:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658622.420408:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788658622.420412:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025271424:0@lo:8:kworker.0 00000004:00080000:2.0:1788658622.423107:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788658622.426077:0:18667:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1788658622.426449:0:18667:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788658622.426458:0:18667:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:2.0:1788658622.449474:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.449492:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fc9d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.449512:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.449518:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.449526:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fc9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.449548:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fc9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.449577:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fc9d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.449586:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fc9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.449619:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658622.450832:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658622.450844:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fc9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.450855:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658622.450860:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fc9d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.450883:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fc9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.450904:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fc9d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.450911:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fc9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.450940:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658622.450949:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658622.450952:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658622.461769:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658622.461785:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c6fca4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.461802:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1788658622.461807:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658622.461814:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c6fca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.461829:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c6fca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.461838:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c6fca4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.461845:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c6fca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.461874:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658622.462499:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658622.462514:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c6fca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.462525:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658622.462530:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c6fca4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.462541:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c6fca4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.462561:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c6fca4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.462570:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000118db647/0x48e67cc629c6fca4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.462594:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658622.462596:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658622.462598:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658622.468240:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658622.468255:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c6fcab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.468273:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1788658622.468278:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658622.468284:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c6fcab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.468312:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c6fcab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.468324:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c6fcab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.468332:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c6fcab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.468371:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788658622.469045:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658622.469063:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6c3c83/0x48e67cc629c6fcb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.469074:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1788658622.469078:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658622.469083:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b6c3c83/0x48e67cc629c6fcb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.469093:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b6c3c83/0x48e67cc629c6fcb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.469100:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6c3c83/0x48e67cc629c6fcb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.469120:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b6c3c83/0x48e67cc629c6fcb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.469146:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788658622.470543:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658622.470559:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c6fcab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.470574:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2044000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.470580:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c6fcab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.470591:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c6fcab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.470619:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c6fcab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.470628:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b77c973d/0x48e67cc629c6fcab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.470669:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658622.470674:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b6c3c83/0x48e67cc629c6fcb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.470681:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.470696:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6c3c83/0x48e67cc629c6fcb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.470722:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6c3c83/0x48e67cc629c6fcb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.470733:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b6c3c83/0x48e67cc629c6fcb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.470741:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b6c3c83/0x48e67cc629c6fcb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.470756:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.470758:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.470760:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658622.471377:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658622.471388:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c6fcb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.471401:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1788658622.471406:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658622.471413:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c6fcb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.471426:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c6fcb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.471436:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c6fcb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.471444:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c6fcb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.471472:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658622.471834:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658622.471842:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c6fcb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.471851:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2045e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658622.471856:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c6fcb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.471876:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c6fcb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.471892:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c6fcb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.471899:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000237738c6/0x48e67cc629c6fcb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.471919:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658622.471920:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658622.471922:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.472780:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.478161:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.478260:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fcc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.478279:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.478284:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.478300:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fcc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.478318:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fcc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.478330:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fcc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.478337:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fcc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.478364:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658622.479418:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658622.479429:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fcc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.479447:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658622.479452:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fcc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.479461:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fcc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.479481:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fcc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.479489:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fcc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.479509:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658622.479511:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658622.479513:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658622.494567:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658622.494583:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000923254bf/0x48e67cc629c6fcc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.494601:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788658622.494606:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658622.494614:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000923254bf/0x48e67cc629c6fcc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.494629:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000923254bf/0x48e67cc629c6fcc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.494670:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000923254bf/0x48e67cc629c6fcc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.494677:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000923254bf/0x48e67cc629c6fcc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.494969:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788658622.496801:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658622.496815:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c79a0d3/0x48e67cc629c6fcce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.496833:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788658622.496838:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658622.496845:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c79a0d3/0x48e67cc629c6fcce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.496877:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c79a0d3/0x48e67cc629c6fcce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.496888:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c79a0d3/0x48e67cc629c6fcce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.496896:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c79a0d3/0x48e67cc629c6fcce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.500229:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658622.500246:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000923254bf/0x48e67cc629c6fcc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.500260:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658622.500265:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000923254bf/0x48e67cc629c6fcc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.500277:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000923254bf/0x48e67cc629c6fcc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.500298:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000923254bf/0x48e67cc629c6fcc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.500321:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000923254bf/0x48e67cc629c6fcc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.500350:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658622.500355:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c79a0d3/0x48e67cc629c6fcce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.500362:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658622.500366:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c79a0d3/0x48e67cc629c6fcce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.500374:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c79a0d3/0x48e67cc629c6fcce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.500385:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c79a0d3/0x48e67cc629c6fcce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.500394:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658622.500395:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658622.500398:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.505396:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788658622.505793:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.506947:0:18667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c79a0d3/0x48e67cc629c6fcce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658622.520237:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658622.520253:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab55beda/0x48e67cc629c6fcd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.520519:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788658622.520525:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658622.520533:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab55beda/0x48e67cc629c6fcd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.520551:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab55beda/0x48e67cc629c6fcd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.520566:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab55beda/0x48e67cc629c6fcd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.520575:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab55beda/0x48e67cc629c6fcd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.520610:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658622.521409:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658622.521419:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab55beda/0x48e67cc629c6fcd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.521431:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658622.521435:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab55beda/0x48e67cc629c6fcd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.521456:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab55beda/0x48e67cc629c6fcd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.521475:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab55beda/0x48e67cc629c6fcd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.521483:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab55beda/0x48e67cc629c6fcd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.521505:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658622.521507:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658622.521509:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658622.525856:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658622.525881:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b275fad8/0x48e67cc629c6fcdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.525905:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788658622.525910:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658622.525917:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b275fad8/0x48e67cc629c6fcdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.525933:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b275fad8/0x48e67cc629c6fcdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.525945:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b275fad8/0x48e67cc629c6fcdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.525954:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b275fad8/0x48e67cc629c6fcdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.525982:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658622.526488:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658622.526497:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b275fad8/0x48e67cc629c6fcdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.526507:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658622.526513:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b275fad8/0x48e67cc629c6fcdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.526524:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b275fad8/0x48e67cc629c6fcdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.526542:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b275fad8/0x48e67cc629c6fcdc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.526563:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b275fad8/0x48e67cc629c6fcdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.526585:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658622.526588:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658622.526590:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.529369:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.529386:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e7b989f/0x48e67cc629c6fce3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.529406:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.529418:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.529426:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e7b989f/0x48e67cc629c6fce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.529441:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e7b989f/0x48e67cc629c6fce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.529452:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e7b989f/0x48e67cc629c6fce3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.529461:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e7b989f/0x48e67cc629c6fce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.533075:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658622.533091:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e7b989f/0x48e67cc629c6fce3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.533118:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658622.533125:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e7b989f/0x48e67cc629c6fce3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.533137:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e7b989f/0x48e67cc629c6fce3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.533163:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e7b989f/0x48e67cc629c6fce3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.533187:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.533189:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.533191:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658622.533561:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658622.533571:0:18667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e7b989f/0x48e67cc629c6fce3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.534690:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.534901:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.534911:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d387a3df/0x48e67cc629c6fcea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.534927:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.534931:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.534937:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d387a3df/0x48e67cc629c6fcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.534953:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d387a3df/0x48e67cc629c6fcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.534974:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d387a3df/0x48e67cc629c6fcea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.534982:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d387a3df/0x48e67cc629c6fcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.535000:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658622.535266:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658622.535273:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d387a3df/0x48e67cc629c6fcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.535282:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658622.535288:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d387a3df/0x48e67cc629c6fcea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.535299:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d387a3df/0x48e67cc629c6fcea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.535316:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d387a3df/0x48e67cc629c6fcea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.535331:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d387a3df/0x48e67cc629c6fcea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.535352:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.535354:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.535356:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.535570:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.535577:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6fcf1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.535586:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.535590:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.535594:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6fcf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.535604:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6fcf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.535613:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6fcf1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.535621:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6fcf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.535657:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658622.536134:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.536260:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002735b5a/0x48e67cc629c6fcf8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.536271:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.536275:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.536280:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002735b5a/0x48e67cc629c6fcf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.536291:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002735b5a/0x48e67cc629c6fcf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.536300:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002735b5a/0x48e67cc629c6fcf8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.536309:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002735b5a/0x48e67cc629c6fcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.536331:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788658622.536648:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658622.536654:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6fcf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.536662:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658622.536666:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6fcf1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.536675:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6fcf1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.536689:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6fcf1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.536697:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e878865/0x48e67cc629c6fcf1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.536734:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658622.536737:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002735b5a/0x48e67cc629c6fcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.536753:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658622.536756:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002735b5a/0x48e67cc629c6fcf8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.536764:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002735b5a/0x48e67cc629c6fcf8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.536777:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002735b5a/0x48e67cc629c6fcf8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.536783:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002735b5a/0x48e67cc629c6fcf8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.536795:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.536797:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.536798:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.537068:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.537074:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008871a632/0x48e67cc629c6fcff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.537084:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.537094:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.537099:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008871a632/0x48e67cc629c6fcff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.537110:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008871a632/0x48e67cc629c6fcff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.537118:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008871a632/0x48e67cc629c6fcff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.537124:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008871a632/0x48e67cc629c6fcff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.537145:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658622.537545:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658622.537552:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008871a632/0x48e67cc629c6fcff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.537561:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658622.537565:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008871a632/0x48e67cc629c6fcff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.537575:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008871a632/0x48e67cc629c6fcff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.537594:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008871a632/0x48e67cc629c6fcff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.537609:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008871a632/0x48e67cc629c6fcff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.537629:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.537641:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.537644:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.537686:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.537693:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b45cb7b/0x48e67cc629c6fd06 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.537723:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.537727:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.537733:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b45cb7b/0x48e67cc629c6fd06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.537744:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b45cb7b/0x48e67cc629c6fd06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.537753:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b45cb7b/0x48e67cc629c6fd06 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.537767:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b45cb7b/0x48e67cc629c6fd06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.537790:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658622.537808:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658622.537814:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b45cb7b/0x48e67cc629c6fd06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.537823:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658622.537827:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b45cb7b/0x48e67cc629c6fd06 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.537836:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b45cb7b/0x48e67cc629c6fd06 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.537849:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b45cb7b/0x48e67cc629c6fd06 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.537866:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b45cb7b/0x48e67cc629c6fd06 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.537902:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.537904:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.537906:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.538502:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.538510:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fd0d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.538520:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.538523:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.538528:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fd0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.538538:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fd0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.538546:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fd0d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.538555:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fd0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.538576:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658622.538739:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658622.538746:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fd0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.538754:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658622.538757:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fd0d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.538765:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fd0d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.538777:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fd0d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.538784:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff54e846/0x48e67cc629c6fd0d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.538800:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.538802:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.538804:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.540073:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.540089:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000887db2a5/0x48e67cc629c6fd14 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.540112:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.540117:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.540122:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000887db2a5/0x48e67cc629c6fd14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.540135:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000887db2a5/0x48e67cc629c6fd14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.540145:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000887db2a5/0x48e67cc629c6fd14 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.540154:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000887db2a5/0x48e67cc629c6fd14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.540176:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658622.540365:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658622.540374:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000887db2a5/0x48e67cc629c6fd14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.540383:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658622.540387:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000887db2a5/0x48e67cc629c6fd14 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.540396:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000887db2a5/0x48e67cc629c6fd14 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.540411:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000887db2a5/0x48e67cc629c6fd14 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.540419:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000887db2a5/0x48e67cc629c6fd14 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658622.540438:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658622.540440:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658622.540447:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658622.542028:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.542135:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.542146:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03bec0f/0x48e67cc629c6fd1b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.542161:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.542165:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.542171:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f03bec0f/0x48e67cc629c6fd1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.542185:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f03bec0f/0x48e67cc629c6fd1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.542203:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f03bec0f/0x48e67cc629c6fd1b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.542211:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f03bec0f/0x48e67cc629c6fd1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.542242:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658622.542582:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658622.542590:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f03bec0f/0x48e67cc629c6fd1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.542599:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.542604:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03bec0f/0x48e67cc629c6fd1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.542614:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f03bec0f/0x48e67cc629c6fd1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.542654:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f03bec0f/0x48e67cc629c6fd1b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.542663:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f03bec0f/0x48e67cc629c6fd1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.542683:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.542685:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.542686:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.542987:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.542994:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc93ed7d/0x48e67cc629c6fd22 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.543003:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.543006:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.543011:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc93ed7d/0x48e67cc629c6fd22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.543021:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc93ed7d/0x48e67cc629c6fd22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.543028:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc93ed7d/0x48e67cc629c6fd22 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.543035:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc93ed7d/0x48e67cc629c6fd22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.543992:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658622.544062:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658622.544072:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc93ed7d/0x48e67cc629c6fd22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.544094:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658622.544099:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc93ed7d/0x48e67cc629c6fd22 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.544109:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc93ed7d/0x48e67cc629c6fd22 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.544126:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc93ed7d/0x48e67cc629c6fd22 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.544133:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc93ed7d/0x48e67cc629c6fd22 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658622.544152:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.544154:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658622.544156:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.544809:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.544819:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceb65ad6/0x48e67cc629c6fd29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.544830:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.544834:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.544840:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ceb65ad6/0x48e67cc629c6fd29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.544870:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ceb65ad6/0x48e67cc629c6fd29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.544880:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ceb65ad6/0x48e67cc629c6fd29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.544888:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ceb65ad6/0x48e67cc629c6fd29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.544912:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658622.545383:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.545391:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a14d053/0x48e67cc629c6fd30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.545401:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.545411:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.545416:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a14d053/0x48e67cc629c6fd30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.545426:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a14d053/0x48e67cc629c6fd30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.545435:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a14d053/0x48e67cc629c6fd30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.545442:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a14d053/0x48e67cc629c6fd30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.545458:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788658622.545759:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.545765:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fd37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.545774:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.545777:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.545781:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fd37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.545790:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fd37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.545799:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fd37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.545812:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fd37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.545821:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788658622.546263:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.546270:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000830c9160/0x48e67cc629c6fd3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.546279:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.546282:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.546287:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000830c9160/0x48e67cc629c6fd3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.546297:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000830c9160/0x48e67cc629c6fd3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.546304:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000830c9160/0x48e67cc629c6fd3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.546311:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000830c9160/0x48e67cc629c6fd3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.546321:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788658622.546601:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.546608:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caaf7890/0x48e67cc629c6fd45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.546623:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.546626:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.546631:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caaf7890/0x48e67cc629c6fd45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.546641:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caaf7890/0x48e67cc629c6fd45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.546650:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caaf7890/0x48e67cc629c6fd45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.546657:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caaf7890/0x48e67cc629c6fd45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.546667:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1788658622.546828:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788658622.546836:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ceb65ad6/0x48e67cc629c6fd29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546846:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.546850:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceb65ad6/0x48e67cc629c6fd29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546872:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ceb65ad6/0x48e67cc629c6fd29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546889:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ceb65ad6/0x48e67cc629c6fd29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546897:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ceb65ad6/0x48e67cc629c6fd29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546929:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788658622.546932:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a14d053/0x48e67cc629c6fd30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546938:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a0200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.546941:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a14d053/0x48e67cc629c6fd30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546949:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a14d053/0x48e67cc629c6fd30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546959:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a14d053/0x48e67cc629c6fd30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546966:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a14d053/0x48e67cc629c6fd30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546978:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788658622.546981:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fd37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.546987:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.546991:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fd37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547009:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fd37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547019:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fd37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547026:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fd37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547039:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658622.547043:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000830c9160/0x48e67cc629c6fd3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547049:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.547052:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000830c9160/0x48e67cc629c6fd3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547058:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000830c9160/0x48e67cc629c6fd3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547067:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000830c9160/0x48e67cc629c6fd3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547074:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000830c9160/0x48e67cc629c6fd3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547096:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658622.547100:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caaf7890/0x48e67cc629c6fd45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547105:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.547109:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caaf7890/0x48e67cc629c6fd45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547117:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caaf7890/0x48e67cc629c6fd45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547126:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caaf7890/0x48e67cc629c6fd45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547132:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caaf7890/0x48e67cc629c6fd45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.547143:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.547145:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.547147:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.548020:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.548031:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c6fd4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.548053:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.548057:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.548063:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c6fd4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.548075:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c6fd4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.548097:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c6fd4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.548105:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c6fd4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.548134:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658622.548144:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658622.548152:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c6fd4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.548161:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.548173:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c6fd4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.548181:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c6fd4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.548194:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c6fd4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.548201:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c6fd4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.548216:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.548218:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.548220:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658622.549638:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.549650:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000544c00b4/0x48e67cc629c6fd53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.549663:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.549666:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.549672:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000544c00b4/0x48e67cc629c6fd53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.549684:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000544c00b4/0x48e67cc629c6fd53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.549694:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000544c00b4/0x48e67cc629c6fd53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.549728:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000544c00b4/0x48e67cc629c6fd53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.549766:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658622.549776:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658622.549783:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000544c00b4/0x48e67cc629c6fd53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.549791:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.549796:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000544c00b4/0x48e67cc629c6fd53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.549805:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000544c00b4/0x48e67cc629c6fd53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.549820:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000544c00b4/0x48e67cc629c6fd53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.549838:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000544c00b4/0x48e67cc629c6fd53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658622.550249:0:18667:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658622.550255:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e00b2554/0x48e67cc629c6fd5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.550264:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788658622.550267:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658622.550270:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e00b2554/0x48e67cc629c6fd5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.550280:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e00b2554/0x48e67cc629c6fd5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.550287:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e00b2554/0x48e67cc629c6fd5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.550293:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e00b2554/0x48e67cc629c6fd5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658622.550301:0:18667:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788658622.550330:0:18667:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00010000:00010000:1.0:1788658622.550342:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658622.550348:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e00b2554/0x48e67cc629c6fd5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.550355:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658622.550359:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e00b2554/0x48e67cc629c6fd5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.550366:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e00b2554/0x48e67cc629c6fd5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.550378:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e00b2554/0x48e67cc629c6fd5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.550386:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e00b2554/0x48e67cc629c6fd5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658622.550402:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.550404:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658622.550406:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658622.550450:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17187:x1875544025270912:12345-0@lo:5:osp-pre-0-0.0 Request processed in 137349us (137544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658622.550461:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658622.550525:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1875544025270912:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788658622.550552:0:17187:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788658622.550600:0:17187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1875544025271936:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788658622.550638:0:17187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658622.550664:0:17187:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788658622.550683:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025271936 00000100:00100000:2.0:1788658622.550688:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025271936 00000100:00100000:2.0:1788658622.550762:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658622.550770:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17187:x1875544025271936:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788658622.550811:0:18669:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1788658622.551814:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788658622.567490:0:18664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:1.0:1788658622.567540:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788658622.567946:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17187:x1875544025271936:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17171us (17302us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788658622.567958:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658622.570647:0:17187:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788658622.570662:0:17187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17187:1875544025271936:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788658622.570679:0:17187:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:1.0:1788658622.911039:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025272064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658622.911121:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658622.911211:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025272064 00000100:00100000:3.0:1788658622.911219:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025272064 00000100:00100000:3.0:1788658622.911275:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788658622.911286:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025272064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788658622.911323:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788658622.911503:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025272192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658622.911535:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658622.911567:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025272192 00000100:00100000:0.0:1788658622.911571:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025272192 00000100:00100000:0.0:1788658622.911591:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788658622.911598:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025272192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658622.911619:0:18107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788658622.911654:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025272192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658622.911661:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788658622.911733:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025272192:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658622.911862:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025272064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 578us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658622.911870:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658622.912086:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025272064:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788658623.552089:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658624.575214:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658624.770457:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788658625.071276:0:19483:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788658625.071280:0:19483:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788658625.071281:0:19483:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788658625.071357:0:19483:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a1eb4839000 00000020:01000004:3.0:1788658625.071370:0:19483:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788658625.071384:0:19483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788658625.071399:0:19483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a1e84453380) 00000020:00000080:3.0:1788658625.071418:0:19483:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788658625.113241:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788658625.116754:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788658625.117048:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788658625.117411:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788658625.117610:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788658625.117838:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788658625.118230:0:19483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:0.0:1788658625.119475:0:19483:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788658625.119942:0:19483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788658625.119966:0:19483:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788658625.119981:0:19483:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x48e67cc629c6fd68 00000020:01000004:0.0:1788658625.119989:0:19483:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788658625.120013:0:19483:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.153@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788658625.120017:0:19483:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.153@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788658625.120025:0:19483:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788658625.120062:0:19483:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788658625.120067:0:19483:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.153@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788658625.130594:0:19483:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.153@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788658625.130661:0:19483:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.153@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788658625.130676:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788658625.130678:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788658625.130680:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658625.130681:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658625.130683:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658625.130684:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658625.130686:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658625.130687:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658625.130689:0:19483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658625.130692:0:19483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788658625.130695:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658625.130697:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788658625.130698:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658625.130699:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658625.130732:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658625.130735:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658625.130736:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658625.130737:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658625.130738:0:19483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788658625.130764:0:19483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788658625.130786:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272320:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788658625.131077:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.131176:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e85848540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658625.131223:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025272320 00000100:00100000:2.0:1788658625.131231:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025272320 00000100:00100000:2.0:1788658625.131337:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788658625.131349:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:19483:x1875544025272320:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788658625.131397:0:17154:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788658625.131400:0:17154:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788658625.131404:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788658625.131739:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:19483:x1875544025272320:12345-0@lo:253:mount.lustre.0 Request processed in 391us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.131749:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788658625.131887:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272320:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788658625.131899:0:19483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788658625.131902:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788658625.131904:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788658625.131905:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658625.131907:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658625.131908:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658625.131909:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658625.131910:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658625.131919:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658625.131921:0:19483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788658625.131956:0:19483:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a1eb4839000 from lustre-OST0001 10000000:01000000:0.0:1788658625.131987:0:19483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788658625.131991:0:19483:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788658625.132001:0:19483:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a1eb23f0000 local copy 00010000:00010000:0.0:1788658625.132012:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658625.132092:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272448:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658625.132123:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.132418:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eabc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658625.132491:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025272448 00000100:00100000:3.0:1788658625.132496:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025272448 00000100:00100000:3.0:1788658625.132525:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788658625.132532:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:19483:x1875544025272448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658625.132624:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:19483:x1875544025272448:12345-0@lo:501:mount.lustre.0 Request processed in 92us (500us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788658625.132632:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788658625.132737:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272448:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788658625.132751:0:19483:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.153@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788658625.132768:0:19483:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.153@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788658625.132774:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.132784:0:19483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1e81670c00/0x48e67cc629c6f9b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6f9be expref: -99 pid: 17141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658625.132810:0:19483:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a1eb4839000 10000000:01000000:0.0:1788658625.132815:0:19483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788658625.132820:0:19483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788658625.132822:0:19483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658625.132827:0:19483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788658625.132830:0:19483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788658625.132864:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.132885:0:19483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.132895:0:19483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658625.132909:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658625.132938:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.132964:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eabc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658625.133103:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025272576 00000100:00100000:3.0:1788658625.133108:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025272576 00000100:00100000:3.0:1788658625.133127:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788658625.133134:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:19483:x1875544025272576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658625.133145:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658625.133159:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96800/0x48e67cc629c6fd76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fd6f expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658625.133182:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96800/0x48e67cc629c6fd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fd6f expref: 22 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658625.133201:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96800/0x48e67cc629c6fd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fd6f expref: 22 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658625.133211:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96800, rc 0) 00000100:00100000:3.0:1788658625.133249:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025272576:12345-0@lo:101:mount.lustre.0 Request processed in 115us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.133255:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788658625.133439:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658625.133452:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.133461:0:19483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658625.135284:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788658625.136131:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658625.138206:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788658625.138262:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788658625.138280:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788658625.138294:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788658625.138308:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788658625.138321:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788658625.138345:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788658625.138350:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788658625.138457:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658625.138525:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.138583:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab900 going to sleep for 11 seconds 00000100:00100000:3.0:1788658625.138876:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025272704 00000100:00100000:3.0:1788658625.138884:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025272704 00000100:00100000:3.0:1788658625.138930:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788658625.138940:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025272704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658625.139186:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025272704:12345-0@lo:501:mount.lustre.0 Request processed in 246us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.139195:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788658625.139335:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658625.139371:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658625.139413:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.139691:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab900 going to sleep for 11 seconds 00000100:00100000:3.0:1788658625.139757:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025272832 00000100:00100000:3.0:1788658625.139761:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025272832 00000100:00100000:3.0:1788658625.139798:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788658625.139806:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025272832:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658625.140685:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025272832:12345-0@lo:503:mount.lustre.0 Request processed in 873us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.140695:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788658625.141080:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272832:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788658625.141551:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658625.141648:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658625.141833:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658625.142053:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e989a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788658625.142097:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025272960 00000100:00100000:3.0:1788658625.142105:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025272960 00000100:00100000:3.0:1788658625.142188:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788658625.142201:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025272960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658625.142639:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025272960:12345-0@lo:502:mount.lustre.0 Request processed in 438us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.142655:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788658625.142784:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025272960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658625.143060:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788658625.143092:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788658625.143106:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788658625.143121:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788658625.143131:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788658625.143142:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788658625.143172:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788658625.143188:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788658625.143199:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788658625.143232:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658625.143284:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658625.143979:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e989a9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658625.144131:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025273088 00000100:00100000:0.0:1788658625.144142:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025273088 00000100:00100000:0.0:1788658625.144192:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788658625.144201:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025273088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658625.144341:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025273088:12345-0@lo:502:mount.lustre.0 Request processed in 140us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.144350:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788658625.144442:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658625.144516:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788658625.144528:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788658625.145456:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788658625.145466:0:19487:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788658625.145472:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.145475:0:19487:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788658625.145480:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658625.145496:0:19487:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a1eb3973380) 00000020:00000080:2.0:1788658625.145521:0:19487:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788658625.145527:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788658625.145596:0:19487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1eb4839000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788658625.145606:0:19487:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658625.145613:0:19487:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x48e67cc629c6fd84 00010000:00010000:2.0:1788658625.153384:0:19487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788658625.154130:0:19487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788658625.155562:0:19487:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788658625.157386:0:19487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788658625.157399:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658625.157406:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.157408:0:19487:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788658625.157411:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658625.157415:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.157416:0:19487:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658625.157419:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658625.157421:0:19487:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788658625.157423:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658625.157425:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.157427:0:19487:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788658625.157429:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658625.157431:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.157433:0:19487:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788658625.157436:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788658625.157465:0:19487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658625.157468:0:19487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.157469:0:19487:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788658625.157473:0:19487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788658625.157645:0:19483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788658625.157691:0:19483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788658625.157796:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.157810:0:19483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec2045c00/0x48e67cc629c6fd6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fd76 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658625.157839:0:19483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1eb4839000 from 1 10000000:01000000:0.0:1788658625.157843:0:19483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658625.157890:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.157898:0:19483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.157910:0:19483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658625.158117:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273216:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658625.158186:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.158235:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eabc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658625.158298:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025273216 00000100:00100000:2.0:1788658625.158306:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025273216 00000100:00100000:2.0:1788658625.158359:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788658625.158370:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025273216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658625.158384:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658625.158399:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6fd92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fd8b expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.158423:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6fd92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fd8b expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.158441:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6fd92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fd8b expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.158450:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391a00, rc 0) 00000100:00100000:2.0:1788658625.158490:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:19483:x1875544025273216:12345-0@lo:101:mount.lustre.0 Request processed in 122us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.158497:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788658625.158587:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658625.158602:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.158610:0:19483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658625.159771:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788658625.160181:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658625.160364:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788658625.160389:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788658625.160408:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788658625.160413:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788658625.160485:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273344:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658625.160548:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.160651:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658625.164942:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025273344 00000100:00100000:2.0:1788658625.165022:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025273344 00000100:00100000:2.0:1788658625.165122:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788658625.165133:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:19483:x1875544025273344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658625.165336:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:19483:x1875544025273344:12345-0@lo:501:mount.lustre.0 Request processed in 204us (4787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.165344:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788658625.165449:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658625.165514:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658625.165568:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658625.166395:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658625.166476:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025273472 00000100:00100000:3.0:1788658625.166485:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025273472 00000100:00100000:3.0:1788658625.166525:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788658625.166535:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:19483:x1875544025273472:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658625.166677:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:19483:x1875544025273472:12345-0@lo:503:mount.lustre.0 Request processed in 131us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.166683:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788658625.166966:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273472:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788658625.167495:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658625.167604:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273600:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658625.167662:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658625.167736:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658625.168212:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025273600 00000100:00100000:3.0:1788658625.168220:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025273600 00000100:00100000:3.0:1788658625.168258:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788658625.168267:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:19483:x1875544025273600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658625.168388:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:19483:x1875544025273600:12345-0@lo:502:mount.lustre.0 Request processed in 120us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.168396:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788658625.168569:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273600:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658625.168840:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788658625.169105:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788658625.169121:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788658625.169135:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788658625.169146:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788658625.169159:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788658625.169170:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788658625.169182:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788658625.169194:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788658625.169206:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788658625.169218:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788658625.169250:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273728:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658625.169303:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658625.169325:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658625.169835:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025273728 00000100:00100000:3.0:1788658625.169843:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025273728 00000100:00100000:3.0:1788658625.170983:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788658625.171005:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:19483:x1875544025273728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658625.171169:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:19483:x1875544025273728:12345-0@lo:502:mount.lustre.0 Request processed in 173us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.171177:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788658625.171346:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273728:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658625.171431:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788658625.171445:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788658625.173532:0:19491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658625.173549:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.173551:0:19491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788658625.173559:0:19491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1eb4839000 00000020:00000080:2.0:1788658625.173562:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788658625.173572:0:19491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658625.173575:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.173576:0:19491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788658625.173579:0:19491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658625.173581:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.173582:0:19491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788658625.173585:0:19491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a1eb4839000 00000020:00000080:2.0:1788658625.173587:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788658625.173649:0:19491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658625.173675:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.173677:0:19491:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788658625.173681:0:19491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658625.173683:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.173685:0:19491:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788658625.173689:0:19491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1eb4839000 00000020:00000080:2.0:1788658625.173692:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788658625.173917:0:19491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658625.173921:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.173923:0:19491:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788658625.173926:0:19491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658625.173929:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.173931:0:19491:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788658625.173934:0:19491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a1eb4839000 00000020:00000080:2.0:1788658625.173936:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788658625.174039:0:19491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658625.174042:0:19491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658625.174044:0:19491:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788658625.174047:0:19491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788658625.177762:0:19483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788658625.177814:0:19483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788658625.177835:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.178018:0:19483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658625.178088:0:19483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788658625.178091:0:19483:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a1eb4839000 10000000:01000000:1.0:1788658625.178095:0:19483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a1eb4839000 10000000:01000000:1.0:1788658625.178099:0:19483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788658625.178105:0:19483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a1eb4839000 from 1 10000000:01000000:1.0:1788658625.178108:0:19483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788658625.178158:0:19483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.178167:0:19483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.178179:0:19483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658625.178204:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273856:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788658625.178284:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658625.178328:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658625.178386:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025273856 00000100:00100000:0.0:1788658625.178394:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025273856 00000100:00100000:0.0:1788658625.178446:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788658625.178456:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:19483:x1875544025273856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658625.178469:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658625.178481:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ec2045e00/0x48e67cc629c6fda0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fd99 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.178514:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ec2045e00/0x48e67cc629c6fda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fd99 expref: 24 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.178526:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ec2045e00/0x48e67cc629c6fda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fd99 expref: 24 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658625.178535:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ec2045e00, rc 0) 00000100:00100000:0.0:1788658625.178572:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025273856:12345-0@lo:101:mount.lustre.0 Request processed in 117us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.178578:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788658625.178673:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658625.178688:0:19483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.178698:0:19483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788658625.183366:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788658625.183725:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658625.187178:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788658625.187243:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788658625.187259:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788658625.187272:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788658625.187284:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788658625.187297:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788658625.187308:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788658625.187320:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788658625.187332:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788658625.187344:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788658625.187355:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788658625.187368:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788658625.187379:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788658625.187414:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788658625.187430:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788658625.187443:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788658625.187456:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788658625.187471:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788658625.187483:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788658625.187495:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788658625.187518:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788658625.187530:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788658625.187542:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788658625.187554:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788658625.187566:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788658625.187579:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788658625.187592:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788658625.187603:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788658625.187615:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788658625.187639:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788658625.187654:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788658625.187679:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788658625.187694:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788658625.187732:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788658625.187747:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788658625.187758:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788658625.187771:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788658625.187784:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788658625.187796:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788658625.187807:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788658625.187818:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788658625.187832:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788658625.190161:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788658625.190236:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788658625.190253:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788658625.190283:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788658625.190311:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788658625.190317:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788658625.190442:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658625.190523:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658625.190577:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658625.191838:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025273984 00000100:00100000:1.0:1788658625.191921:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025273984 00000100:00100000:1.0:1788658625.192092:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788658625.192105:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025273984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658625.192292:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025273984:12345-0@lo:501:mount.lustre.0 Request processed in 189us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658625.192301:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788658625.196897:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025273984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658625.197099:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025274112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658625.197186:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658625.197240:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658625.197779:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025274112 00000100:00100000:1.0:1788658625.197788:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025274112 00000100:00100000:1.0:1788658625.197924:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788658625.197934:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025274112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658625.198157:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025274112:12345-0@lo:503:mount.lustre.0 Request processed in 223us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658625.198165:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788658625.198223:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025274112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788658625.198697:0:19483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788658625.198806:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025274240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658625.201050:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658625.201118:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025274240 00000100:00100000:1.0:1788658625.201129:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025274240 00000100:00100000:1.0:1788658625.201175:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788658625.201185:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025274240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658625.201343:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025274240:12345-0@lo:502:mount.lustre.0 Request processed in 159us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658625.201352:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788658625.201405:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658625.201431:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025274240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658625.201673:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788658625.201728:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788658625.201746:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788658625.201760:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788658625.201774:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788658625.201786:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788658625.201799:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788658625.201810:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788658625.201824:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788658625.201837:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788658625.203556:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788658625.203593:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788658625.203626:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788658625.203642:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788658625.203654:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788658625.203678:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788658625.203694:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788658625.203728:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788658625.203741:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788658625.203752:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788658625.203762:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788658625.203773:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788658625.203784:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788658625.203796:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788658625.203806:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788658625.203826:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788658625.203840:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788658625.208889:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788658625.208999:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788658625.209025:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788658625.209038:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788658625.209051:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788658625.209063:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788658625.209077:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788658625.209089:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788658625.209102:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788658625.209114:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788658625.209126:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788658625.209139:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788658625.209151:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788658625.209164:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788658625.209176:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788658625.209190:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788658625.209203:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788658625.209231:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788658625.209246:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788658625.209259:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788658625.209273:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788658625.209352:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025274368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658625.209457:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658625.209515:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658625.210163:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025274368 00000100:00100000:2.0:1788658625.210174:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025274368 00000100:00100000:2.0:1788658625.210232:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788658625.210242:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025274368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658625.210398:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025274368:12345-0@lo:502:mount.lustre.0 Request processed in 155us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.210407:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788658625.210658:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025274368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658625.213169:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788658625.213228:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788658625.213287:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025274496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658625.213384:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658625.213440:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025274496 00000100:00100000:1.0:1788658625.213448:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025274496 00000100:00100000:1.0:1788658625.213501:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788658625.213510:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025274496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658625.213625:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025274496:12345-0@lo:502:mount.lustre.0 Request processed in 113us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658625.213633:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788658625.213690:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658625.213737:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025274496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658625.213783:0:19483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788658625.213791:0:19483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788658625.217246:0:19496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788658625.217267:0:19496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a1eb39719c0) 00000020:00000080:2.0:1788658625.217296:0:19496:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788658625.217374:0:19496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1eb4839000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788658625.217379:0:19496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1eb4839000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788658625.217388:0:19496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1eb4839000 3 00010000:00080000:2.0:1788658625.217432:0:19496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1e92f80800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.153@tcp at head 00010000:00010000:2.0:1788658625.224071:0:19496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788658625.224358:0:19496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788658625.224426:0:19496:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788658625.224444:0:19496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x48e67cc629c6fdae 00000100:00080000:2.0:1788658625.224460:0:19496:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658625.224471:0:19496:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a1e92f80800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:2.0:1788658625.224524:0:19496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1ebdb3ea00 x1875544025274624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658625.224582:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025274624:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788658625.227234:0:19496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788658625.227373:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658625.227455:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025274624 00000100:00100000:2.0:1788658625.227464:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025274624 00000100:00100000:2.0:1788658625.227503:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788658625.227512:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875544025274624:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788658625.227543:0:17163:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1788658625.227607:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x48e67cc629c6fdb5 00000004:00100000:2.0:1788658625.227625:0:17163:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788658625.227675:0:17163:0:(import.c:65:import_set_state_nolock()) ffff8a1d810f1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658625.227759:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875544025274624:12345-0@lo:38:llog_process_th.0 Request processed in 246us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.227768:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788658625.227818:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1ebdb3ea00 x1875544025274624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658625.227830:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658625.227853:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788658625.227870:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788658625.227875:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788658625.227878:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1e92f80800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658625.227885:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875544025274624:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788658625.228445:0:19496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788658625.228462:0:19496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8a1e844519c0) 00000020:00000080:3.0:1788658625.228485:0:19496:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788658625.228601:0:19496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a1eb4839000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788658625.228606:0:19496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a1eb4839000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788658625.228608:0:19496:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a1eb4839000 3 00010000:00080000:3.0:1788658625.228642:0:19496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a1d83704000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.153@tcp at head 00010000:00010000:3.0:1788658625.234793:0:19496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788658625.235447:0:19496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788658625.235498:0:19496:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788658625.235513:0:19496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x48e67cc629c6fdc3 00000100:00080000:3.0:1788658625.235525:0:19496:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658625.235532:0:19496:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8a1d83704000 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658625.235571:0:19496:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d8379aa00 x1875544025274752/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658625.235594:0:19496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788658625.237610:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875544025274752:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788658625.237734:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658625.237811:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025274752 00000100:00100000:2.0:1788658625.237820:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025274752 00000100:00100000:2.0:1788658625.237864:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658625.237871:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875544025274752:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788658625.237900:0:17164:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1788658625.238071:0:17164:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x48e67cc629c6fdca 00000004:00100000:2.0:1788658625.238086:0:17164:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788658625.238125:0:17164:0:(import.c:65:import_set_state_nolock()) ffff8a1d810f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658625.238177:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875544025274752:12345-0@lo:38:llog_process_th.0 Request processed in 305us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.238184:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788658625.238227:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d8379aa00 x1875544025274752/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658625.238238:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788658625.238245:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788658625.238252:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788658625.238257:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788658625.238259:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1d83704000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658625.238265:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d8379aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875544025274752:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788658625.238540:0:19496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788658625.238830:0:19483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788658625.238916:0:19483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788658625.239030:0:19483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658625.239042:0:19483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d83418200/0x48e67cc629c6fd99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fda0 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788658625.239092:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788658625.239095:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788658625.239096:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658625.239097:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658625.239099:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658625.239100:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658625.239101:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658625.239103:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658625.239104:0:19483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788658625.239108:0:19483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788658625.239114:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788658625.239115:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788658625.239116:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658625.239117:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658625.239118:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658625.239119:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658625.239121:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658625.239122:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658625.239123:0:19483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788658625.239141:0:19483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788658625.239156:0:19483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025274880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788658625.239198:0:19483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658625.239226:0:19483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d824f5840 going to sleep for 11 seconds 00000100:00080000:0.0:1788658625.239998:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658625.240004:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788658625.240008:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658625.240014:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 539 00000100:00080000:0.0:1788658625.240018:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788658625.240023:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1eb3235800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658625.240042:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1d83d50e00 x1875544025275264/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788658625.240086:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788658625.240089:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788658625.240091:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788658625.240094:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 539 00000100:00080000:0.0:1788658625.240097:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788658625.240101:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ec1295800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:0.0:1788658625.240111:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb7400000 x1875544025275776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658625.240173:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025275520:0@lo:400:kworker.0 00000100:00100000:0.0:1788658625.240214:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.240236:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025276160:0@lo:400:kworker.0 00000100:00100000:0.0:1788658625.240258:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.240280:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788658625.240286:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025275392:0@lo:400:kworker.0 00000100:00100000:0.0:1788658625.240306:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.240322:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025276032:0@lo:400:kworker.0 00000100:00100000:0.0:1788658625.240339:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.240367:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025275520 00000100:00100000:0.0:1788658625.240372:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025275520 00000100:00100000:0.0:1788658625.240410:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658625.240417:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025275520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658625.240465:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025275520:12345-0@lo:400:kworker.0 Request processed in 47us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658625.240472:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658625.240509:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025275520:0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.242037:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025274880 00000100:00100000:3.0:1788658625.242051:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025274880 00000100:00100000:3.0:1788658625.242153:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788658625.242163:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:19483:x1875544025274880:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788658625.242193:0:17154:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788658625.242209:0:17154:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788658625.242340:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025275136:0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.242403:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658625.242439:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025275904:0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.242464:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658625.242487:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788658625.242494:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025275008:0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.242515:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658625.242541:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025275648:0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.242561:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658625.242589:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025275008 00000100:00100000:3.0:1788658625.242593:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025275008 00000100:00100000:3.0:1788658625.242621:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788658625.242628:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025275008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.242687:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025275008:12345-0@lo:400:kworker.0 Request processed in 59us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.242695:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788658625.242742:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025275136 00000100:00100000:3.0:1788658625.242746:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025275136 00000100:00100000:3.0:1788658625.242787:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025275648 00000100:00100000:3.0:1788658625.242790:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025275648 00000100:00100000:3.0:1788658625.242809:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658625.242815:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025275136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.242860:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025275136:12345-0@lo:400:kworker.0 Request processed in 44us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.242866:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658625.242877:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658625.242884:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025275648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.242911:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025275648:12345-0@lo:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.242917:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658625.242934:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025276160 00000100:00100000:3.0:1788658625.242937:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025276160 00000100:00100000:3.0:1788658625.242960:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025275392 00000100:00100000:3.0:1788658625.242963:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025275392 00000100:00100000:3.0:1788658625.242974:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025276032 00000100:00100000:3.0:1788658625.242982:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025276032 00000100:00100000:3.0:1788658625.243000:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025275904 00000100:00100000:3.0:1788658625.243002:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025275904 00000100:00100000:3.0:1788658625.243015:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658625.243020:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025276160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.243059:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025276160:12345-0@lo:400:kworker.0 Request processed in 39us (2799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.243065:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788658625.243076:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658625.243082:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025275392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.243106:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025275392:12345-0@lo:400:kworker.0 Request processed in 24us (2799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.243112:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658625.243120:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788658625.243125:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025276032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.243146:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025276032:12345-0@lo:400:kworker.0 Request processed in 21us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.243152:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788658625.243162:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788658625.243167:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025275904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.243190:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025275904:12345-0@lo:400:kworker.0 Request processed in 22us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658625.243195:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788658625.243216:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658625.243220:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658625.243222:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788658625.243258:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d83d50700 x1875544025275392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658625.243279:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025275392:0@lo:400:kworker.0 00010000:00080000:3.0:1788658625.243294:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d834e5880 x1875544025276032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658625.243302:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025276032:0@lo:400:kworker.0 00010000:00080000:3.0:1788658625.243314:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1d834e7800 x1875544025276160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658625.243322:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025276160:0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.243360:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025275008:0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.243371:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025275648:0@lo:400:kworker.0 00000100:00100000:3.0:1788658625.243381:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025275136:0@lo:400:kworker.0 00010000:00080000:3.0:1788658625.243390:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a1eb7400e00 x1875544025275904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658625.243398:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025275904:0@lo:400:kworker.0 00000100:00100000:0.0:1788658625.245209:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025275264:0@lo:8:kworker.0 00000100:00100000:0.0:1788658625.245298:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658625.245345:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025275776:0@lo:8:kworker.0 00000100:00100000:0.0:1788658625.245374:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658625.245454:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025275264 00000100:00100000:3.0:1788658625.245463:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025275264 00000100:00100000:3.0:1788658625.245505:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025275776 00000100:00100000:3.0:1788658625.245508:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025275776 00000100:00100000:3.0:1788658625.245523:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658625.245532:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025275264:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788658625.245610:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025275264:12345-0@lo:8:kworker.0 Request processed in 77us (312us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788658625.245618:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788658625.245648:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658625.245652:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025275776:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788658625.245698:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025275776:12345-0@lo:8:kworker.0 Request processed in 44us (323us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788658625.245733:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788658625.245780:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788658625.245793:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658625.245799:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788658625.245802:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025275264:0@lo:8:kworker.0 00000100:00100000:3.0:1788658625.245812:0:3646:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788658625.245815:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658625.245818:0:3646:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788658625.245821:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025275776:0@lo:8:kworker.0 20000000:01000000:3.0:1788658625.248438:0:17154:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788658625.248458:0:17154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788658625.248634:0:17178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788658625.248640:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788658625.248675:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.248694:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1ec2045600/0x48e67cc629c6fc7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fc73 expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.248723:0:17178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1d83419200/0x48e67cc629c6fc88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fc81 expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.248734:0:17178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.248783:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1d83419200/0x48e67cc629c6fc88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fc81 expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.248799:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1d83419200/0x48e67cc629c6fc88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fc81 expref: 24 pid: 17157 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658625.248816:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025276288:0@lo:104: 00000100:00100000:2.0:1788658625.248901:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658625.248965:0:17178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1ec2045600/0x48e67cc629c6fc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fc73 expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.248973:0:17178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1ec2045600/0x48e67cc629c6fc7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fc73 expref: 24 pid: 17157 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658625.248982:0:17178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025276416:0@lo:104: 00000100:00100000:2.0:1788658625.249003:0:17178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658625.249039:0:17178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1193840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658625.249061:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025276288 00000100:00100000:2.0:1788658625.249067:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025276288 00000100:00100000:2.0:1788658625.249106:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025276416 00000100:00100000:2.0:1788658625.249109:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025276416 00000100:00100000:2.0:1788658625.249121:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658625.249128:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+4:17178:x1875544025276288:12345-0@lo:104: 00010000:00010000:2.0:1788658625.249141:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249188:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788658625.249194:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+4:17178:x1875544025276288:12345-0@lo:104: Request processed in 66us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.249201:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658625.249218:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658625.249224:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:17178:x1875544025276416:12345-0@lo:104: 00010000:00010000:2.0:1788658625.249233:0:17145:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249263:0:17145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788658625.249267:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:17178:x1875544025276416:12345-0@lo:104: Request processed in 44us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.249272:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658625.249305:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025276288:0@lo:104: 00000100:00100000:2.0:1788658625.249314:0:17178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17178:1875544025276416:0@lo:104: 00010000:00010000:2.0:1788658625.249334:0:17178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249350:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658625.249361:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249367:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96e00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658625.249371:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249379:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658625.249386:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658625.249392:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788658625.249417:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249424:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658625.249443:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249450:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b96e00/0x48e67cc629c6fc81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fc88 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249462:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658625.249464:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249470:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:2.0:1788658625.249472:0:17151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249490:0:17151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658625.249496:0:17151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658625.249501:0:17151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788658625.249516:0:17151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249522:0:17151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658625.249528:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249535:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1000/0x48e67cc629c6fc73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fc7a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249549:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658625.249551:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658625.249553:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658625.249564:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025276544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658625.249592:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658625.249613:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658625.249618:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025276672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658625.249637:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658625.249677:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025276544 00000100:00100000:2.0:1788658625.249681:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025276544 00010000:00010000:2.0:1788658625.249698:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1d83419200/0x48e67cc629c6fc88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fc81 expref: 25 pid: 17157 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658625.249752:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025276672 00000100:00100000:2.0:1788658625.249755:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025276672 00010000:00010000:2.0:1788658625.249766:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1ec2045600/0x48e67cc629c6fc7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fc73 expref: 26 pid: 17157 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658625.249781:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658625.249787:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+26:3647:x1875544025276544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658625.249798:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658625.249803:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1d83419200/0x48e67cc629c6fc88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fc81 expref: 26 pid: 17157 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249814:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1d83419200/0x48e67cc629c6fc88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fc81 expref: 26 pid: 17157 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249828:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83419200/0x48e67cc629c6fc88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fc81 expref: 26 pid: 17157 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249838:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658625.249868:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+25:3647:x1875544025276544:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.249874:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658625.249887:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658625.249893:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3647:x1875544025276672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658625.249901:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658625.249905:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1ec2045600/0x48e67cc629c6fc7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fc73 expref: 24 pid: 17157 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249915:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1ec2045600/0x48e67cc629c6fc7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fc73 expref: 24 pid: 17157 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249931:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1ec2045600/0x48e67cc629c6fc7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fc73 expref: 24 pid: 17157 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249943:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249952:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788658625.249964:0:17148:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003888168s 00010000:00010000:2.0:1788658625.249969:0:17148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249975:0:17148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249982:0:17148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249988:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.249994:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658625.249999:0:17148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.250006:0:17148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.250020:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.250034:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658625.250057:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:3647:x1875544025276672:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.250063:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788658625.250085:0:17178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.250093:0:17178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658625.250099:0:17178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3390a00/0x48e67cc629c6fdd1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658625.250125:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025276672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658625.250132:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025276544:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658625.250455:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658625.250689:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:19483:x1875544025274880:12345-0@lo:253:mount.lustre.0 Request processed in 8527us (11489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658625.250698:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788658625.251138:0:19483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:913293d7-fe00-4834-a4c1-1b0cae17d59a:19483:1875544025274880:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788658625.251155:0:19483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788658625.251159:0:19483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788658625.251161:0:19483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788658625.251163:0:19483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658625.251165:0:19483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658625.251166:0:19483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658625.251168:0:19483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658625.251170:0:19483:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658625.251172:0:19483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658625.251174:0:19483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788658625.251190:0:19483:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1788658625.253654:0:19483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788658625.261453:0:19483:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788658625.261464:0:19483:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788658625.261500:0:19483:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788658625.261551:0:19483:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.153@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788658625.261571:0:19483:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788658625.261598:0:19483:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788658625.262633:0:19483:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658625.264171:0:19483:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788658625.599134:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788658626.198781:0:19549:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788658626.199158:0:19549:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788658626.494988:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658626.495017:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025276800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788658626.495099:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658626.495149:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025276800 00000100:00100000:0.0:1788658626.495167:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025276800 00000100:00100000:0.0:1788658626.495410:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658626.495420:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025276800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658626.495453:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788658626.495504:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025276800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658626.495511:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658626.495580:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025276800:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788658626.624996:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788658626.878792:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788658626.878800:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1e82c42000 from 10 10000000:01000000:2.0:1788658626.878806:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658626.878906:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658626.878920:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658626.878938:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658626.878968:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025276928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658626.879099:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658626.879157:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1193c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788658626.879176:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025276928 00000100:00100000:3.0:1788658626.879185:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025276928 00000100:00100000:3.0:1788658626.879303:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788658626.879313:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:17159:x1875544025276928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658626.879328:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658626.879343:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fdd8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658626.879367:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fdd8 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658626.879386:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b97600/0x48e67cc629c6fddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fdd8 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658626.879395:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97600, rc 0) 00000100:00100000:3.0:1788658626.879464:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:17159:x1875544025276928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658626.879471:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788658626.879563:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025276928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658626.879579:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658626.879599:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658626.879652:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025277056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788658626.879683:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658626.880189:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1193c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788658626.880293:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025277056 00000100:00100000:1.0:1788658626.880301:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025277056 00000100:00100000:1.0:1788658626.880332:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788658626.880342:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:17159:x1875544025277056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788658626.880360:0:17157:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788658626.880379:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788658626.880383:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788658626.880697:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:17159:x1875544025277056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 355us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658626.880723:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788658626.882502:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025277056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788658626.882605:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788658626.882617:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658626.882628:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390e00/0x48e67cc629c6fdd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fddf expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658626.882639:0:17159:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788658626.882642:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a1eb751f000 from 10 10000000:01000000:2.0:1788658626.882652:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658626.882685:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658626.882694:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658626.882719:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658626.882742:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025277184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658626.882801:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658626.882850:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e903d4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658626.883122:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025277184 00000100:00100000:1.0:1788658626.883130:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025277184 00000100:00100000:1.0:1788658626.883185:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788658626.883195:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:17159:x1875544025277184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658626.883208:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658626.883222:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83419600/0x48e67cc629c6fded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6fde6 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658626.883248:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83419600/0x48e67cc629c6fded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6fde6 expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658626.883261:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83419600/0x48e67cc629c6fded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fde6 expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658626.883271:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419600, rc 0) 00000100:00100000:1.0:1788658626.883314:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:17159:x1875544025277184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658626.883322:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788658626.883361:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025277184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658626.883374:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658626.883384:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658626.883434:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025277312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788658626.883466:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658626.883480:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f2603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658626.883503:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025277312 00000100:00100000:1.0:1788658626.883506:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025277312 00000100:00100000:1.0:1788658626.883525:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788658626.883530:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:17159:x1875544025277312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788658626.883554:0:17154:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788658626.883568:0:17154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788658626.883571:0:17154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788658626.883637:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:17159:x1875544025277312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658626.883650:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788658626.883678:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025277312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788658626.883750:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658626.883757:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658626.883767:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3390800/0x48e67cc629c6fde6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6fded expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658627.519000:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025277440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658627.519080:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658627.520881:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025277440 00000100:00100000:2.0:1788658627.520900:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025277440 00000100:00100000:2.0:1788658627.520984:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788658627.520997:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025277440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658627.521024:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788658627.521122:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658627.525241:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025277440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4236us (6149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658627.525256:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658627.525479:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025277440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788658627.649793:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658628.031779:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025277568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788658628.031863:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658628.032099:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025277568 00000100:00100000:1.0:1788658628.032109:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025277568 00000100:00100000:1.0:1788658628.032161:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788658628.032172:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025277568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658628.032212:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788658628.032265:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025277568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658628.032283:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788658628.032336:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025277568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658628.039647:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025277696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658628.039774:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658628.039870:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025277696 00000100:00100000:0.0:1788658628.039879:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025277696 00000100:00100000:0.0:1788658628.039939:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788658628.039950:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025277696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658628.040367:0:18107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788658628.040430:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8379aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025277696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 482us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658628.040439:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788658628.040485:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025277696:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788658628.672036:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658629.699562:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658630.272065:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788658630.591748:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025277824:0@lo:400:kworker.0 00000100:00100000:2.0:1788658630.591827:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658630.591868:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025277824 00000100:00100000:1.0:1788658630.591876:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025277824 00000100:00100000:1.0:1788658630.591926:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788658630.591937:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3649:x1875544025277824:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788658630.596455:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658630.596462:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788658630.596466:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658630.596478:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a1eb3235800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658630.596499:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb377ca80 x1875544025278208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658630.596530:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658630.596533:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788658630.596535:0:36:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658630.596538:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8a1ec1295800 using connection 192.168.202.153@tcp/0@lo 00000100:00100000:3.0:1788658630.596566:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a1eb377e680 x1875544025278720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658630.596626:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025277952:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.596689:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.596730:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025278592:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.596750:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.596764:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025279232:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.596786:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.596804:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788658630.596809:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025278464:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.596826:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.596837:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025279104:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.596852:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.596873:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025278080:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.596891:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.596903:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025278848:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.596918:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.596938:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025279360:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.596957:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.596970:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788658630.596974:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025278336:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.596990:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.596998:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025278976:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.597011:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.597037:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025278208:0@lo:8:kworker.0 00000100:00100000:3.0:1788658630.597056:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.597068:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025278720:0@lo:8:kworker.0 00000100:00100000:3.0:1788658630.597083:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.597107:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025277952 00000100:00100000:3.0:1788658630.597113:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025277952 00000100:00100000:3.0:1788658630.597149:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025278464 00000100:00100000:3.0:1788658630.597151:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025278464 00000100:00100000:3.0:1788658630.597164:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788658630.597171:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025277952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.597221:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025277952:12345-0@lo:400:kworker.0 Request processed in 50us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.597228:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788658630.597244:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658630.597249:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025278464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.597284:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025278464:12345-0@lo:400:kworker.0 Request processed in 34us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.597290:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658630.597304:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025278592 00000100:00100000:3.0:1788658630.597307:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025278592 00000100:00100000:3.0:1788658630.597331:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025278080 00000100:00100000:3.0:1788658630.597333:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025278080 00000100:00100000:3.0:1788658630.597342:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025278208 00000100:00100000:3.0:1788658630.597344:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025278208 00000100:00100000:3.0:1788658630.597352:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025278720 00000100:00100000:3.0:1788658630.597354:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025278720 00000100:00100000:3.0:1788658630.597361:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658630.597367:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025278592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.597400:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025278592:12345-0@lo:400:kworker.0 Request processed in 33us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.597406:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658630.597416:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658630.597421:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025278080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.597443:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025278080:12345-0@lo:400:kworker.0 Request processed in 22us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.597449:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658630.597457:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658630.597460:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025278208:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788658630.597483:0:19325:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:3.0:1788658630.597509:0:19325:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x48e67cc629c6fdf4 00002000:00100000:3.0:1788658630.597521:0:19325:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a1d831d7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788658630.597525:0:19325:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788658630.597527:0:19325:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788658630.597736:0:19325:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788658630.597757:0:19325:0:(import.c:65:import_set_state_nolock()) ffff8a1d831d2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658630.597790:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1875544025278208:12345-0@lo:8:kworker.0 Request processed in 328us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.597796:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658630.597807:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658630.597811:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875544025278720:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788658630.597823:0:19325:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 547 last 0 00000020:00000080:3.0:1788658630.597837:0:19325:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x48e67cc629c6fdfb 00002000:00100000:3.0:1788658630.597842:0:19325:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8a1d831d6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788658630.597849:0:19325:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788658630.597851:0:19325:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788658630.597869:0:19325:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788658630.597880:0:19325:0:(import.c:65:import_set_state_nolock()) ffff8a1eb4838000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658630.597903:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1875544025278720:12345-0@lo:8:kworker.0 Request processed in 91us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.597909:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658630.597925:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025279232 00000100:00100000:3.0:1788658630.597928:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025279232 00000100:00100000:3.0:1788658630.597946:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025279104 00000100:00100000:3.0:1788658630.597948:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025279104 00000100:00100000:3.0:1788658630.597957:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025278848 00000100:00100000:3.0:1788658630.597959:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025278848 00000100:00100000:3.0:1788658630.597967:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025279360 00000100:00100000:3.0:1788658630.597969:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025279360 00000100:00100000:3.0:1788658630.597978:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025278336 00000100:00100000:3.0:1788658630.597980:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025278336 00000100:00100000:3.0:1788658630.597989:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025278976 00000100:00100000:3.0:1788658630.597990:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025278976 00000100:00100000:3.0:1788658630.598000:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658630.598005:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025279232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.598030:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025279232:12345-0@lo:400:kworker.0 Request processed in 25us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.598035:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788658630.598044:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658630.598049:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025279104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.598067:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025279104:12345-0@lo:400:kworker.0 Request processed in 18us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.598072:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658630.598087:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788658630.598091:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025278848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.598112:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025278848:12345-0@lo:400:kworker.0 Request processed in 21us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.598118:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788658630.598125:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788658630.598130:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025279360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.598148:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025279360:12345-0@lo:400:kworker.0 Request processed in 18us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.598153:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788658630.598161:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788658630.598166:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025278336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.598183:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025278336:12345-0@lo:400:kworker.0 Request processed in 17us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.598188:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788658630.598196:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788658630.598200:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025278976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.598218:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025278976:12345-0@lo:400:kworker.0 Request processed in 17us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658630.598223:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788658630.598254:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658630.598257:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658630.598259:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788658630.598296:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377ca80 x1875544025278208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658630.598310:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788658630.598322:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788658630.598326:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788658630.598329:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1eb3235800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788658630.598349:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788658630.598354:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875544025278208:0@lo:8:kworker.0 00010000:00080000:3.0:1788658630.598366:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377e680 x1875544025278720/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788658630.598375:0:3646:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788658630.598379:0:3646:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788658630.598382:0:3646:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788658630.598383:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1295800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788658630.598393:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788658630.598395:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875544025278720:0@lo:8:kworker.0 00010000:00080000:3.0:1788658630.598424:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377df80 x1875544025278336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658630.598433:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025278336:0@lo:400:kworker.0 00010000:00080000:3.0:1788658630.598441:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377ce00 x1875544025278976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658630.598450:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025278976:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.598459:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025278080:0@lo:400:kworker.0 00010000:00080000:3.0:1788658630.598468:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377e300 x1875544025278848/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658630.598475:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025278848:0@lo:400:kworker.0 00010000:00080000:3.0:1788658630.598492:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377c700 x1875544025279360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658630.598499:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025279360:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.598526:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025278464:0@lo:400:kworker.0 00010000:00080000:3.0:1788658630.598535:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377d500 x1875544025279104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658630.598543:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025279104:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.598552:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025277952:0@lo:400:kworker.0 00000100:00100000:3.0:1788658630.598560:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025278592:0@lo:400:kworker.0 00010000:00080000:3.0:1788658630.598568:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377c000 x1875544025279232/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658630.598575:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025279232:0@lo:400:kworker.0 00000100:00100000:1.0:1788658630.604416:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3649:x1875544025277824:12345-0@lo:400:kworker.0 Request processed in 12465us (12573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658630.604433:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000004:00080000:1.0:1788658630.604476:0:17188:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788658630.604577:0:17188:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 547820873238ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788658630.604592:0:17188:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788658630.604673:0:17905:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788658630.604721:0:17905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875544025279616:0@lo:7:osp-pre-1-1.0 00000100:00100000:1.0:1788658630.604781:0:17905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658630.604808:0:17905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1eb3482780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658630.604826:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025279488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658630.604854:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658630.604895:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025279616 00000100:00100000:1.0:1788658630.604902:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025279616 00000100:00100000:1.0:1788658630.604959:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658630.604969:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17905:x1875544025279616:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788658630.605307:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb7400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025277824:0@lo:400:kworker.0 00000100:00100000:1.0:1788658630.605331:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025279488 00000100:00100000:1.0:1788658630.605337:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025279488 00000100:00100000:1.0:1788658630.605368:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658630.605383:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875544025279488:12345-0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788658630.605384:0:17189:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788658630.605408:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1875544025279872:0@lo:5:osp-pre-1-0.0 00002000:00000024:1.0:1788658630.605410:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788658630.605446:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658630.605471:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec121ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658630.605475:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875544025279488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658630.605483:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:2.0:1788658630.605487:0:17904:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:1.0:1788658630.605504:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658630.605515:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025279872 00000100:00100000:1.0:1788658630.605519:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025279872 00000100:00100000:1.0:1788658630.605553:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1788658630.605555:0:17904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 547821850514ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788658630.605563:0:17904:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788658630.605565:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17189:x1875544025279872:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:1.0:1788658630.605622:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cf480 x1875544025279488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658630.605639:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025279488:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788658630.605655:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658630.605853:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658630.605865:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025279744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658630.605893:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658630.605917:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025279744 00000100:00100000:1.0:1788658630.605921:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025279744 00000100:00100000:1.0:1788658630.605944:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658630.605951:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875544025279744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788658630.605963:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788658630.606002:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875544025279744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658630.606008:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788658630.606331:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1ebdb3d180 x1875544025279744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658630.606348:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025279744:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788658630.607344:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788658630.608151:0:19325:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788658630.608164:0:19325:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788658630.608333:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17905:x1875544025279616:12345-0@lo:7:osp-pre-1-1.0 Request processed in 3360us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658630.608346:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788658630.608540:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cd180 x1875544025279616/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788658646 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658630.608613:0:17905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875544025279616:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788658630.608630:0:17905:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788658630.608671:0:17905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875544025280000:0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788658630.608869:0:18670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788658630.608877:0:18670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788658630.608882:0:18670:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:1.0:1788658630.608898:0:17905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658630.608926:0:17905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab300 going to sleep for 11 seconds 00000004:00080000:1.0:1788658630.608966:0:17894:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788658630.608992:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025280000 00000100:00100000:1.0:1788658630.608998:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025280000 00000100:00100000:1.0:1788658630.609036:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658630.609044:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17905:x1875544025280000:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788658630.609071:0:18669:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788658630.609101:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17905:x1875544025280000:12345-0@lo:5:osp-pre-1-1.0 Request processed in 58us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658630.609108:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788658630.609132:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d837cd180 x1875544025280000/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788658646 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658630.609142:0:17905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875544025280000:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788658630.609150:0:17905:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788658630.609174:0:17905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875544025280128:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788658630.609203:0:17905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658630.609215:0:17905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e83eab300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658630.609225:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025280128 00000100:00100000:1.0:1788658630.609228:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025280128 00000100:00100000:1.0:1788658630.609262:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658630.609279:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17905:x1875544025280128:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788658630.609306:0:18669:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:2.0:1788658630.620219:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658630.620233:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe02 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.620251:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1788658630.620257:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658630.620274:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.620293:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.620315:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe02 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.620323:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.620342:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658630.620484:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658630.620491:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.620501:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658630.620506:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe02 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.620517:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe02 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.620536:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe02 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.620544:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe02 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.620570:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.620578:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.620580:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658630.622486:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658630.622501:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000184f157c/0x48e67cc629c6fe09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.622531:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1788658630.622536:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658630.622542:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000184f157c/0x48e67cc629c6fe09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.622622:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000184f157c/0x48e67cc629c6fe09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.622635:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000184f157c/0x48e67cc629c6fe09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.622645:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000184f157c/0x48e67cc629c6fe09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.622667:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788658630.623280:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658630.623287:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6fe10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.623297:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1788658630.623301:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658630.623306:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6fe10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.623316:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6fe10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.623338:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6fe10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.623347:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6fe10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.623364:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788658630.624184:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658630.624192:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624204:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1788658630.624208:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658630.624213:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624225:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624233:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624239:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624261:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788658630.624370:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788658630.624377:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000184f157c/0x48e67cc629c6fe09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624385:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.624390:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000184f157c/0x48e67cc629c6fe09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624400:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000184f157c/0x48e67cc629c6fe09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624418:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000184f157c/0x48e67cc629c6fe09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624426:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000184f157c/0x48e67cc629c6fe09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624442:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658630.624446:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6fe10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624452:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.624455:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6fe10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624473:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6fe10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624483:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6fe10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624491:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6fe10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624503:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658630.624507:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624514:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.624517:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624526:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624536:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624544:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.624576:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.624578:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.624580:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.624593:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658630.630898:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658630.630912:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.630930:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1788658630.630935:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658630.630941:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.630960:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.630970:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.630978:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.631043:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658630.631422:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658630.631428:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caaf7890/0x48e67cc629c6fe25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.631437:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1788658630.631440:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658630.631444:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caaf7890/0x48e67cc629c6fe25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.631460:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caaf7890/0x48e67cc629c6fe25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.631469:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caaf7890/0x48e67cc629c6fe25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.631476:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caaf7890/0x48e67cc629c6fe25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.631510:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658630.631519:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.631527:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.631532:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.631541:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.631568:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.631577:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8877d16/0x48e67cc629c6fe1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.631595:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658630.631598:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caaf7890/0x48e67cc629c6fe25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.631604:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.631614:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caaf7890/0x48e67cc629c6fe25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.631621:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caaf7890/0x48e67cc629c6fe25 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.631631:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caaf7890/0x48e67cc629c6fe25 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.631639:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.631641:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.631643:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.633576:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658630.633784:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caaf7890/0x48e67cc629c6fe25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658630.634336:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658630.634344:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830c9160/0x48e67cc629c6fe2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.634360:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1788658630.634366:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658630.634373:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000830c9160/0x48e67cc629c6fe2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.634386:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000830c9160/0x48e67cc629c6fe2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.634407:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830c9160/0x48e67cc629c6fe2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.634415:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000830c9160/0x48e67cc629c6fe2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.634430:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788658630.636272:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658630.636285:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6fe33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.636301:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1788658630.636305:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658630.636310:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6fe33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.636325:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6fe33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.636348:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6fe33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.636355:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6fe33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.636365:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788658630.636645:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658630.636655:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000830c9160/0x48e67cc629c6fe2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.636664:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.636669:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000830c9160/0x48e67cc629c6fe2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.636680:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000830c9160/0x48e67cc629c6fe2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.636698:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000830c9160/0x48e67cc629c6fe2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.636737:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000830c9160/0x48e67cc629c6fe2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.636769:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658630.636773:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6fe33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.636780:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.636784:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6fe33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.636792:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6fe33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.636803:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6fe33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.636810:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026a2c43a/0x48e67cc629c6fe33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.636830:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.636832:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.636835:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.636843:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658630.638207:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658630.638217:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004320a6ec/0x48e67cc629c6fe3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.638230:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1788658630.638235:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658630.638240:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004320a6ec/0x48e67cc629c6fe3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.638253:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004320a6ec/0x48e67cc629c6fe3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.638274:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004320a6ec/0x48e67cc629c6fe3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.638283:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004320a6ec/0x48e67cc629c6fe3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.638315:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658630.638462:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658630.638469:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004320a6ec/0x48e67cc629c6fe3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.638477:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.638488:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004320a6ec/0x48e67cc629c6fe3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.638498:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004320a6ec/0x48e67cc629c6fe3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.638514:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004320a6ec/0x48e67cc629c6fe3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.638521:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004320a6ec/0x48e67cc629c6fe3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.638536:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.638538:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.638540:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658630.638930:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788658630.638936:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf468ef0/0x48e67cc629c6fe41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.638945:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=547s v=(0 0) 00010000:00010000:3.0:1788658630.638948:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658630.638953:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf468ef0/0x48e67cc629c6fe41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.638963:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf468ef0/0x48e67cc629c6fe41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.638971:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf468ef0/0x48e67cc629c6fe41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.638979:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf468ef0/0x48e67cc629c6fe41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.639028:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658630.639521:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658630.639529:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fe48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.639538:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1788658630.639541:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658630.639552:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fe48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.639563:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fe48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.639572:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fe48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.639580:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fe48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.639891:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658630.639898:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf468ef0/0x48e67cc629c6fe41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.639906:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.639910:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf468ef0/0x48e67cc629c6fe41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.639920:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf468ef0/0x48e67cc629c6fe41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.639934:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf468ef0/0x48e67cc629c6fe41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.639949:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf468ef0/0x48e67cc629c6fe41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.639965:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658630.639969:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fe48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.639975:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.639979:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fe48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.639986:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fe48 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.639996:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fe48 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.640003:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.640005:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.640006:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.640114:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658630.640120:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9f4baf5/0x48e67cc629c6fe48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658630.640481:0:19484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788658630.640498:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788658630.640503:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788658630.640677:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17905:x1875544025280128:12345-0@lo:5:osp-pre-1-1.0 Request processed in 31395us (31469us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788658630.640697:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658630.640787:0:17905:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788658630.640795:0:17905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17905:1875544025280128:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788658630.640812:0:17905:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788658630.640866:0:17905:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83671c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17905:1875544025280256:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788658630.640905:0:17905:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658630.640930:0:17905:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e8f260000 going to sleep for 11 seconds 00002000:00010000:2.0:1788658630.641688:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658630.641696:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000544c00b4/0x48e67cc629c6fe4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.641732:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1788658630.641736:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658630.641743:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000544c00b4/0x48e67cc629c6fe4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.641757:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000544c00b4/0x48e67cc629c6fe4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.641768:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000544c00b4/0x48e67cc629c6fe4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.641776:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000544c00b4/0x48e67cc629c6fe4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.641960:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658630.641968:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000544c00b4/0x48e67cc629c6fe4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.641976:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658630.641989:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000544c00b4/0x48e67cc629c6fe4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.641998:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000544c00b4/0x48e67cc629c6fe4f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.642013:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000544c00b4/0x48e67cc629c6fe4f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.642022:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.642024:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.642026:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658630.642057:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025280256 00000100:00100000:0.0:1788658630.642065:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025280256 00000100:00100000:0.0:1788658630.642156:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658630.642167:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17905:x1875544025280256:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788658630.642246:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17905:x1875544025280256:12345-0@lo:900:osp-pre-1-1.0 Request processed in 80us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658630.642253:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788658630.642333:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658630.642340:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000544c00b4/0x48e67cc629c6fe4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658630.642936:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658630.642944:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e00b2554/0x48e67cc629c6fe56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.642954:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1788658630.642958:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658630.642963:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e00b2554/0x48e67cc629c6fe56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.642974:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e00b2554/0x48e67cc629c6fe56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.642982:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e00b2554/0x48e67cc629c6fe56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.642989:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e00b2554/0x48e67cc629c6fe56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.643015:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658630.643336:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788658630.643342:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c6fe5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.643351:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=547s v=(0 0) 00010000:00010000:2.0:1788658630.643355:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658630.643365:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c6fe5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.643376:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c6fe5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.643385:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c6fe5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.643394:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c6fe5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.643402:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788658630.643729:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658630.643737:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e00b2554/0x48e67cc629c6fe56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.643745:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.643750:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e00b2554/0x48e67cc629c6fe56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.643760:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e00b2554/0x48e67cc629c6fe56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.643774:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e00b2554/0x48e67cc629c6fe56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.643781:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e00b2554/0x48e67cc629c6fe56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.643799:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658630.643809:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c6fe5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.643815:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.643819:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c6fe5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.643826:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c6fe5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.643837:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c6fe5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.643844:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a143316c/0x48e67cc629c6fe5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.643858:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.643860:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.643861:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658630.644436:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658630.644818:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658630.644827:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b73c62a7/0x48e67cc629c6fe64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.644839:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788658630.644843:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658630.644849:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b73c62a7/0x48e67cc629c6fe64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.644863:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b73c62a7/0x48e67cc629c6fe64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.644873:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b73c62a7/0x48e67cc629c6fe64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.644883:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b73c62a7/0x48e67cc629c6fe64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.644945:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:0.0:1788658630.645748:0:17905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1d83671c00 x1875544025280256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788658646 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658630.645765:0:17905:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83671c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17905:1875544025280256:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788658630.647926:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658630.647941:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.647959:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788658630.647964:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658630.647970:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.647984:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.647995:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.648004:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.648150:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658630.648161:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b73c62a7/0x48e67cc629c6fe64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.648173:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658630.648178:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b73c62a7/0x48e67cc629c6fe64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.648190:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b73c62a7/0x48e67cc629c6fe64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.648211:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b73c62a7/0x48e67cc629c6fe64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.648244:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b73c62a7/0x48e67cc629c6fe64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.648275:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658630.648279:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.648286:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658630.648291:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.648300:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe6b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.648312:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe6b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.648321:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.648323:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.648325:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658630.648336:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658630.648340:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658630.648343:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658630.649894:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658630.649905:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6fe72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.649919:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788658630.649930:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658630.649936:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6fe72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.649952:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6fe72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.649964:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6fe72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.649973:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6fe72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.649995:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658630.650017:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658630.650025:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6fe72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.650035:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658630.650046:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6fe72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.650055:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6fe72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.650071:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6fe72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.650079:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025375e1a/0x48e67cc629c6fe72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.650096:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.650098:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.650100:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658630.651177:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658630.651188:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c27aaebc/0x48e67cc629c6fe79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.651208:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788658630.651213:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658630.651219:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c27aaebc/0x48e67cc629c6fe79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.651232:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c27aaebc/0x48e67cc629c6fe79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.651242:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c27aaebc/0x48e67cc629c6fe79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.651257:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c27aaebc/0x48e67cc629c6fe79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.651519:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788658630.652278:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658630.652285:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fe80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.652298:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788658630.652302:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658630.652308:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fe80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.652319:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fe80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.652328:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fe80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.652335:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fe80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.652412:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658630.652421:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c27aaebc/0x48e67cc629c6fe79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.652429:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.652435:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c27aaebc/0x48e67cc629c6fe79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.652459:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c27aaebc/0x48e67cc629c6fe79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.652478:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c27aaebc/0x48e67cc629c6fe79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.652485:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c27aaebc/0x48e67cc629c6fe79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.652503:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658630.652507:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fe80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.652513:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.652516:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fe80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.652522:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fe80 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.652532:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fe80 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.652539:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.652541:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.652559:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658630.652697:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658630.652731:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fe80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658630.653187:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658630.653193:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.653203:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788658630.653206:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658630.653211:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.653222:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.653230:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.653237:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.656024:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658630.656040:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.656054:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.656060:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.656073:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe87 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.656095:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe87 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.656103:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.656105:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.656107:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658630.656200:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658630.656210:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658630.658296:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658630.658309:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.658329:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1788658630.658342:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658630.658350:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.658366:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.658378:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.658386:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.658507:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658630.658515:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.658523:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.658528:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.658537:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe8e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.658578:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe8e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.658587:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.658589:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.658591:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.658849:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788658630.658855:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6fe8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658630.659671:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658630.659679:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.659718:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788658630.659723:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658630.659729:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.659743:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.659751:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.659759:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.659813:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658630.659819:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.659828:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419000 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.659832:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.659840:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe95 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.659852:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe95 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.659895:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.659899:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.659901:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658630.661693:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658630.661733:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbc646f5/0x48e67cc629c6fe95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658630.662480:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658630.662488:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.662501:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788658630.662506:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658630.662512:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.662540:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.662608:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.662617:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.662729:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658630.662738:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.662747:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83418a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.662752:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.662770:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe9c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.662786:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe9c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.662796:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.662798:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.662800:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658630.662939:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658630.662945:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab55beda/0x48e67cc629c6fe9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658630.663340:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658630.663345:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fea3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.663355:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788658630.663358:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658630.663363:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.663372:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.663392:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fea3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.663399:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.663411:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658630.663675:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658630.663681:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.663690:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.663694:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fea3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.663722:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fea3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.663738:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fea3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.663745:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000923254bf/0x48e67cc629c6fea3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.663774:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.663776:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.663778:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.663784:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658630.663880:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788658630.663886:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b275fad8/0x48e67cc629c6feaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.663896:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=547s v=(0 0) 00010000:00010000:1.0:1788658630.663899:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658630.663904:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b275fad8/0x48e67cc629c6feaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.663914:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b275fad8/0x48e67cc629c6feaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.663922:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b275fad8/0x48e67cc629c6feaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.663929:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b275fad8/0x48e67cc629c6feaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658630.663993:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788658630.667764:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658630.667782:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6feb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.667800:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1788658630.667805:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658630.667813:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6feb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.667827:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6feb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.667845:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6feb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.667854:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6feb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.668092:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658630.668100:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b275fad8/0x48e67cc629c6feaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.668108:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d83419e00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.668113:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b275fad8/0x48e67cc629c6feaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.668123:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b275fad8/0x48e67cc629c6feaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.668139:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b275fad8/0x48e67cc629c6feaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.668147:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b275fad8/0x48e67cc629c6feaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.668218:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658630.668224:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6feb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.668231:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603600 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658630.668234:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6feb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.668242:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6feb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.668276:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6feb1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658630.668286:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.668288:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658630.668290:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.668966:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788658630.668974:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000baa15b6/0x48e67cc629c6feb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658630.669581:0:18670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788658630.669588:0:18670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6feb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.669602:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1788658630.669606:0:18670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658630.669613:0:18670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6feb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.669625:0:18670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6feb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.669633:0:18670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6feb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658630.669653:0:18670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6feb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.673998:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658630.674016:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6feb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.674033:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602200 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:3.0:1788658630.674049:0:17150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6feb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.674063:0:17150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6feb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.674090:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6feb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658630.674099:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.674101:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658630.674103:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658630.674218:0:18670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788658630.674227:0:18670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087b233e9/0x48e67cc629c6feb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788658630.674366:0:18670:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:3.0:1788658630.674508:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658630.675365:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17189:x1875544025279872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 69796us (69910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658630.675377:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658630.677326:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1875544025279872:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788658630.677348:0:17189:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788658630.677397:0:17189:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1875544025280384:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788658630.677455:0:17189:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658630.677492:0:17189:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ead8f5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788658630.677656:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025280384 00000100:00100000:2.0:1788658630.677664:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025280384 00000100:00100000:2.0:1788658630.677758:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658630.677768:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17189:x1875544025280384:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788658630.677810:0:19325:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1788658630.680768:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17189:x1875544025280384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2994us (3305us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788658630.680780:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788658630.685783:0:17189:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17189:1875544025280384:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788658630.685803:0:17189:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1788658630.727419:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658630.807787:0:19838:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg253-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788658631.622501:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025280512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788658631.622598:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658631.622720:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025280512 00000100:00100000:3.0:1788658631.622729:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025280512 00000100:00100000:3.0:1788658631.622797:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658631.622808:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025280512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788658631.622844:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788658631.630270:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025280512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7450us (7658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658631.630287:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658631.632947:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025280512:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788658631.645282:0:19890:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788658631.645526:0:19890:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788658631.745904:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788658632.494315:0:19941:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788658632.495302:0:19941:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788658632.639024:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658632.639051:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025280640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658632.639134:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658632.639284:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025280640 00000100:00100000:0.0:1788658632.639295:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025280640 00000100:00100000:0.0:1788658632.639356:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658632.639368:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025280640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658632.639404:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788658632.639456:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025280640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.639463:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658632.639512:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025280640:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788658632.639685:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788658632.767120:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658632.777333:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658632.777384:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001073152 00000100:00100000:0.0:1788658632.777411:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001073152 00000100:00100000:0.0:1788658632.777474:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:0.0:1788658632.777483:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1875544001073152:12345-192.168.202.53@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788658632.777511:0:17156:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 67137b4e-5d5d-4374-acb2-2bfe6af790cf@192.168.202.53@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:0.0:1788658632.777537:0:17156:0:(genops.c:1385:class_connect()) connect: client 67137b4e-5d5d-4374-acb2-2bfe6af790cf, cookie 0x48e67cc629c6febf 00000100:00080000:0.0:1788658632.777682:0:17156:0:(import.c:65:import_set_state_nolock()) ffff8a1e840a4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658632.777780:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+5:2395:x1875544001073152:12345-192.168.202.53@tcp:250:mount.lustre.0 Request processed in 296us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.777788:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 117 00000100:00100000:3.0:1788658632.799802:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658632.799999:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001073280 00000100:00100000:1.0:1788658632.800009:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001073280 00000100:00100000:1.0:1788658632.800068:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:1.0:1788658632.800079:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+5:14892:x1875544001073280:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788658632.800096:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658632.800123:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83419e00/0x48e67cc629c6fec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccaf2 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.800153:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83419e00/0x48e67cc629c6fec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaf2 expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.800165:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83419e00/0x48e67cc629c6fec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaf2 expref: 6 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.800185:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419e00, rc 0) 00000100:00100000:1.0:1788658632.800251:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+6:14892:x1875544001073280:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 173us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.800258:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 118 00000100:00100000:2.0:1788658632.805473:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658632.805565:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001073408 00000100:00100000:1.0:1788658632.805580:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001073408 00000100:00100000:1.0:1788658632.805643:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 119 00000100:00100000:1.0:1788658632.805654:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+6:14892:x1875544001073408:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788658632.806272:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+6:14892:x1875544001073408:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 228us (418us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658632.806434:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 119 00000100:00100000:2.0:1788658632.816269:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658632.816368:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001073536 00000100:00100000:0.0:1788658632.816379:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001073536 00000100:00100000:0.0:1788658632.816447:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 120 00000100:00100000:0.0:1788658632.816458:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+6:14892:x1875544001073536:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788658632.816476:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658632.816495:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ebf602000/0x48e67cc629c6fecd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccaf9 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658632.816526:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf602000/0x48e67cc629c6fecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaf9 expref: 7 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658632.816540:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ebf602000/0x48e67cc629c6fecd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccaf9 expref: 7 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658632.816550:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602000, rc 0) 00000100:00100000:0.0:1788658632.816618:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+7:14892:x1875544001073536:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 161us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.816625:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 120 00000100:00100000:3.0:1788658632.827488:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658632.827561:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001073664 00000100:00100000:1.0:1788658632.827570:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001073664 00000100:00100000:1.0:1788658632.827630:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:1.0:1788658632.827642:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+7:14892:x1875544001073664:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788658632.827842:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:14892:x1875544001073664:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 202us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.827850:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 121 00000100:00100000:1.0:1788658632.830328:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658632.830418:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001073792 00000100:00100000:2.0:1788658632.830428:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001073792 00000100:00100000:2.0:1788658632.830496:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:2.0:1788658632.830506:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:14892:x1875544001073792:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788658632.830657:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:14892:x1875544001073792:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 152us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.830665:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 122 00000100:00100000:2.0:1788658632.834566:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658632.834749:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001073920 00000100:00100000:0.0:1788658632.834762:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001073920 00000100:00100000:0.0:1788658632.834818:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:0.0:1788658632.834827:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:14911:x1875544001073920:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658632.834988:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:14911:x1875544001073920:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 162us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.834996:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 123 00000100:00100000:3.0:1788658632.869050:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658632.870471:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001074048 00000100:00100000:1.0:1788658632.870484:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001074048 00000100:00100000:1.0:1788658632.870557:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 124 00000100:00100000:1.0:1788658632.870568:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:14911:x1875544001074048:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658632.870783:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:14911:x1875544001074048:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 216us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.870792:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 124 00000100:00100000:1.0:1788658632.882368:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658632.883849:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001074176 00000100:00100000:2.0:1788658632.883863:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001074176 00000100:00100000:2.0:1788658632.883938:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:2.0:1788658632.883948:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:14911:x1875544001074176:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658632.884122:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:14911:x1875544001074176:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 175us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.884130:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 125 00000100:00100000:2.0:1788658632.903416:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658632.903527:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001074304 00000100:00100000:0.0:1788658632.903536:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001074304 00000100:00100000:0.0:1788658632.903591:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 126 00000100:00100000:0.0:1788658632.903602:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+8:14892:x1875544001074304:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788658632.903619:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658632.903638:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c6fed4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccb2a expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658632.903665:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c6fed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb2a expref: 9 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658632.903676:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ebf603a00/0x48e67cc629c6fed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb2a expref: 9 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658632.903685:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf603a00, rc 0) 00000100:00100000:1.0:1788658632.905642:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+9:14892:x1875544001074304:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 2027us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.905656:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 126 00000100:00100000:0.0:1788658632.913329:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658632.913545:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001074432 00000100:00100000:1.0:1788658632.913557:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001074432 00000100:00100000:1.0:1788658632.913670:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:1.0:1788658632.913680:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+9:14892:x1875544001074432:12345-192.168.202.53@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788658632.913739:0:17157:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788658632.913765:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788658632.913769:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788658632.913772:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788658632.913775:0:17157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788658632.913778:0:17157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788658632.916300:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+9:14892:x1875544001074432:12345-192.168.202.53@tcp:256:mount.lustre.0 Request processed in 2608us (3145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658632.916316:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 127 00000100:00100000:0.0:1788658632.920528:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658632.920689:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001074560 00000100:00100000:1.0:1788658632.920773:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001074560 00000100:00100000:1.0:1788658632.920892:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:1.0:1788658632.920903:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+9:14892:x1875544001074560:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788658632.920921:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658632.920939:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6fedb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccb31 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.920970:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6fedb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb31 expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.920982:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6fedb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb31 expref: 10 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658632.920991:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418000, rc 0) 00000100:00100000:1.0:1788658632.921074:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:14892:x1875544001074560:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 172us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.921081:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 128 00000100:00100000:0.0:1788658632.923687:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658632.923805:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001074688 00000100:00100000:3.0:1788658632.923814:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001074688 00000100:00100000:3.0:1788658632.923872:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:3.0:1788658632.923881:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:14892:x1875544001074688:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788658632.924018:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5e5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:14892:x1875544001074688:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 138us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658632.924023:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 129 00000100:00100000:3.0:1788658632.926616:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658632.926881:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001074816 00000100:00100000:1.0:1788658632.926891:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001074816 00000100:00100000:1.0:1788658632.926986:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 130 00000100:00100000:1.0:1788658632.927005:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:14892:x1875544001074816:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788658632.927344:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:14892:x1875544001074816:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 347us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.927352:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 130 00000100:00100000:0.0:1788658632.929622:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658632.929830:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001074944 00000100:00100000:2.0:1788658632.929840:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001074944 00000100:00100000:2.0:1788658632.929932:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:2.0:1788658632.929943:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:14917:x1875544001074944:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658632.930127:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:14917:x1875544001074944:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 185us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.930136:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 131 00000100:00100000:0.0:1788658632.937345:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658632.937520:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001075072 00000100:00100000:1.0:1788658632.937530:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001075072 00000100:00100000:1.0:1788658632.937620:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:1.0:1788658632.937632:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:14917:x1875544001075072:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658632.937804:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:14917:x1875544001075072:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 175us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.937813:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 132 00000100:00100000:1.0:1788658632.950067:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658632.950166:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658632.950580:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001075200 00000100:00100000:0.0:1788658632.950607:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001075200 00000100:00100000:0.0:1788658632.950660:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001075456 00000100:00100000:0.0:1788658632.950664:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001075456 00000100:00100000:0.0:1788658632.950692:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1788658632.950731:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1875544001075200:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788658632.950761:0:17163:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f934723f-b66d-409a-bfc9-9b206b383163@192.168.202.53@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1788658632.950818:0:17163:0:(genops.c:1385:class_connect()) connect: client f934723f-b66d-409a-bfc9-9b206b383163, cookie 0x48e67cc629c6fee2 00000004:00100000:0.0:1788658632.950841:0:17163:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788658632.951059:0:17163:0:(import.c:65:import_set_state_nolock()) ffff8a1e840a2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658632.951134:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+6:2395:x1875544001075200:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 432us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.951142:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:0.0:1788658632.951173:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:0.0:1788658632.951179:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1875544001075456:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788658632.951195:0:17163:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f934723f-b66d-409a-bfc9-9b206b383163@192.168.202.53@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1788658632.951225:0:17163:0:(genops.c:1385:class_connect()) connect: client f934723f-b66d-409a-bfc9-9b206b383163, cookie 0x48e67cc629c6fee9 00000004:00100000:0.0:1788658632.951238:0:17163:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788658632.951363:0:17163:0:(import.c:65:import_set_state_nolock()) ffff8a1d832d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658632.960374:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+6:2395:x1875544001075456:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 9177us (10191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.960402:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1788658632.960761:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658632.960795:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658632.960875:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001075328 00000100:00100000:0.0:1788658632.960875:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001075712 00000100:00100000:1.0:1788658632.960883:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001075328 00000100:00100000:0.0:1788658632.960883:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001075712 00000100:00100000:1.0:1788658632.960937:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00080000:2.0:1788658632.960938:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658632.960946:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+7:0:x1875544001075328:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788658632.960984:0:18693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788658632.961017:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:0.0:1788658632.961025:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+7:14892:x1875544001075712:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788658632.961038:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788658632.961106:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+7:0:x1875544001075328:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 160us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.961106:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+7:14892:x1875544001075712:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 80us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.961113:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:1.0:1788658632.961116:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:0.0:1788658632.964467:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658632.966253:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001075840 00000100:00100000:2.0:1788658632.966267:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001075840 00000100:00100000:0.0:1788658632.966276:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658632.966366:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001075584 00000100:00100000:2.0:1788658632.966370:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001075584 00000100:00080000:0.0:1788658632.966449:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788658632.966667:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:1.0:1788658632.966680:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+6:14892:x1875544001075840:12345-192.168.202.53@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788658632.966824:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+6:14892:x1875544001075840:12345-192.168.202.53@tcp:40:mount.lustre.0 Request processed in 146us (2366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.966832:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:1.0:1788658632.966851:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:1.0:1788658632.966858:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+6:0:x1875544001075584:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788658632.966881:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788658632.966931:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+6:0:x1875544001075584:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 73us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658632.966937:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:0.0:1788658632.971076:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658632.971161:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658632.971249:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658632.971306:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001075968 00000100:00100000:3.0:1788658632.971316:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001075968 00000100:00100000:3.0:1788658632.971394:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001076096 00000100:00100000:3.0:1788658632.971398:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001076096 00000100:00100000:2.0:1788658632.971455:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001076224 00000100:00100000:2.0:1788658632.971459:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001076224 00000100:00100000:2.0:1788658632.971500:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:2.0:1788658632.971509:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f934723f-b66d-409a-bfc9-9b206b383163+6:14892:x1875544001076224:12345-192.168.202.53@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788658632.971591:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f934723f-b66d-409a-bfc9-9b206b383163+6:14892:x1875544001076224:12345-192.168.202.53@tcp:900:mount.lustre.0 Request processed in 81us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658632.971598:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:0.0:1788658632.971791:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1788658632.971797:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875544001075968:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788658632.971825:0:18667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f934723f-b66d-409a-bfc9-9b206b383163@192.168.202.53@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:0.0:1788658632.971859:0:18667:0:(genops.c:1385:class_connect()) connect: client f934723f-b66d-409a-bfc9-9b206b383163, cookie 0x48e67cc629c6fef0 00002000:00100000:0.0:1788658632.971871:0:18667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f934723f-b66d-409a-bfc9-9b206b383163/ffff8a1d832d3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658632.971890:0:18667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788658632.972118:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:3.0:1788658632.972124:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2395:x1875544001076096:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788658632.972142:0:18669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f934723f-b66d-409a-bfc9-9b206b383163@192.168.202.53@tcp t0 exp 0000000000000000 cur 550 last 0 00000020:00000080:3.0:1788658632.972159:0:18669:0:(genops.c:1385:class_connect()) connect: client f934723f-b66d-409a-bfc9-9b206b383163, cookie 0x48e67cc629c6fef7 00002000:00100000:3.0:1788658632.972163:0:18669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f934723f-b66d-409a-bfc9-9b206b383163/ffff8a1d821b7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788658632.972174:0:18669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788658632.972291:0:18669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788658632.972319:0:18669:0:(import.c:65:import_set_state_nolock()) ffff8a1d821b5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658632.972350:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f934723f-b66d-409a-bfc9-9b206b383163+6:2395:x1875544001076096:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 225us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658632.972357:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00002000:00080000:0.0:1788658632.972515:0:18667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788658632.972530:0:18667:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1212000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658632.972551:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f934723f-b66d-409a-bfc9-9b206b383163+6:2395:x1875544001075968:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 753us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658632.972557:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:0.0:1788658632.976609:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658632.977277:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001076352 00000100:00100000:3.0:1788658632.977288:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001076352 00000100:00100000:3.0:1788658632.977402:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:3.0:1788658632.977413:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+6:14892:x1875544001076352:12345-192.168.202.53@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788658632.982972:0:17165:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5473us 00000004:00200000:3.0:1788658633.001163:0:17165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788658633.001315:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+6:14892:x1875544001076352:12345-192.168.202.53@tcp:33:mount.lustre.0 Request processed in 23896us (24709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658633.001325:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1788658633.150964:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025280768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658633.151048:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658633.151092:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658633.151108:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1ebdb3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025280896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658633.151136:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658633.151287:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025280768 00000100:00100000:3.0:1788658633.151304:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025280768 00000100:00100000:3.0:1788658633.151359:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025280896 00000100:00100000:3.0:1788658633.151363:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025280896 00000100:00100000:3.0:1788658633.151381:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788658633.151387:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788658633.151390:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025280768:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658633.151395:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025280896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788658633.151420:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000004:00000024:0.0:1788658633.151422:0:18107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788658633.151464:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025280768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658633.151472:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788658633.151472:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025280896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658633.151477:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788658633.151638:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1ebdb3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025280896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788658633.151669:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025280768:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658633.216480:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658633.216648:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001076480 00000100:00100000:1.0:1788658633.216657:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001076480 00000100:00100000:1.0:1788658633.216747:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:1.0:1788658633.216759:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+6:14940:x1875544001076480:12345-192.168.202.53@tcp:101:mkdir.0 00010000:00010000:1.0:1788658633.216780:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658633.216805:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6fefe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccb62 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658633.216874:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ff05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658633.216889:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ff05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658633.216904:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ff05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658633.216960:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788658633.216977:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658633.217013:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ff05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658633.217040:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419400/0x48e67cc629c6fefe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb62 expref: 8 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658633.217058:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ff05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb62 expref: 7 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658633.217066:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35c7400) 00010000:00010000:1.0:1788658633.217069:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658633.217085:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419c00, rc 0) 00000100:00100000:1.0:1788658633.217143:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+7:14940:x1875544001076480:12345-192.168.202.53@tcp:101:mkdir.0 Request processed in 387us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658633.217150:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00010000:00010000:3.0:1788658633.791011:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658634.818895:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788658635.007470:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658635.270129:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658635.270405:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001076608 00000100:00100000:2.0:1788658635.270417:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001076608 00000100:00080000:0.0:1788658635.270483:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658635.270507:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:2.0:1788658635.270520:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+7:14992:x1875544001076608:12345-192.168.202.53@tcp:41:lfs.0 00000004:00000024:2.0:1788658635.270559:0:17163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788658635.270650:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+7:14992:x1875544001076608:12345-192.168.202.53@tcp:41:lfs.0 Request processed in 133us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.270658:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:0.0:1788658635.275138:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.277528:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001076736 00000100:00100000:1.0:1788658635.277543:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001076736 00000100:00100000:1.0:1788658635.277733:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:1.0:1788658635.277745:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+6:14992:x1875544001076736:12345-192.168.202.53@tcp:41:lfs.0 00000004:00000024:1.0:1788658635.277790:0:17164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788658635.277908:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+6:14992:x1875544001076736:12345-192.168.202.53@tcp:41:lfs.0 Request processed in 165us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.277915:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00080000:0.0:1788658635.284783:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658635.285615:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658635.285699:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001076864 00000100:00100000:3.0:1788658635.285738:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001076864 00000100:00100000:3.0:1788658635.285827:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:3.0:1788658635.285839:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f934723f-b66d-409a-bfc9-9b206b383163+6:14992:x1875544001076864:12345-192.168.202.53@tcp:13:lfs.0 00002000:00000024:3.0:1788658635.285879:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788658635.286004:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f934723f-b66d-409a-bfc9-9b206b383163+6:14992:x1875544001076864:12345-192.168.202.53@tcp:13:lfs.0 Request processed in 167us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.286013:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00080000:0.0:1788658635.286143:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658635.296896:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658635.297407:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001076992 00000100:00100000:3.0:1788658635.297418:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001076992 00000100:00080000:0.0:1788658635.297578:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658635.297778:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:3.0:1788658635.297791:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f934723f-b66d-409a-bfc9-9b206b383163+6:14992:x1875544001076992:12345-192.168.202.53@tcp:13:lfs.0 00002000:00000024:3.0:1788658635.297832:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788658635.297937:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f934723f-b66d-409a-bfc9-9b206b383163+6:14992:x1875544001076992:12345-192.168.202.53@tcp:13:lfs.0 Request processed in 148us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.297945:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:2.0:1788658635.514306:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.516864:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001077120 00000100:00100000:1.0:1788658635.516882:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001077120 00000100:00100000:1.0:1788658635.517962:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 133 00000100:00100000:1.0:1788658635.517982:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+10:15024:x1875544001077120:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788658635.518015:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658635.518034:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83419400/0x48e67cc629c6ff0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccb69 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.518067:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83419400/0x48e67cc629c6ff0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb69 expref: 11 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.518079:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83419400/0x48e67cc629c6ff0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb69 expref: 11 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.518088:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419400, rc 0) 00000100:00100000:1.0:1788658635.518167:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15024:x1875544001077120:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 194us (3873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.518176:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 133 00000100:00100000:0.0:1788658635.530121:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.530285:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001077248 00000100:00100000:1.0:1788658635.530296:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001077248 00000100:00100000:1.0:1788658635.530352:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 134 00000100:00100000:1.0:1788658635.530363:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15024:x1875544001077248:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788658635.530510:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15024:x1875544001077248:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 149us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.530518:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 134 00000100:00100000:2.0:1788658635.541595:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.541695:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001077376 00000100:00100000:1.0:1788658635.541730:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001077376 00000100:00100000:1.0:1788658635.541825:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 135 00000100:00100000:1.0:1788658635.541837:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15024:x1875544001077376:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788658635.542010:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15024:x1875544001077376:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 174us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.542026:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 135 00000100:00100000:2.0:1788658635.550603:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658635.551748:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001077504 00000100:00100000:3.0:1788658635.551762:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001077504 00000100:00100000:3.0:1788658635.551842:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 136 00000100:00100000:3.0:1788658635.551852:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15032:x1875544001077504:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788658635.552058:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15032:x1875544001077504:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 206us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.552067:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 136 00000100:00100000:0.0:1788658635.583789:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.584080:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001077632 00000100:00100000:1.0:1788658635.584091:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001077632 00000100:00100000:1.0:1788658635.584152:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 137 00000100:00100000:1.0:1788658635.584162:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15032:x1875544001077632:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658635.584326:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15032:x1875544001077632:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 165us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.584335:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 137 00000100:00100000:2.0:1788658635.591027:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.591123:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001077760 00000100:00100000:1.0:1788658635.591132:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001077760 00000100:00100000:1.0:1788658635.591217:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 138 00000100:00100000:1.0:1788658635.591227:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15032:x1875544001077760:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658635.591369:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15032:x1875544001077760:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 143us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.591376:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 138 00000100:00100000:0.0:1788658635.599769:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658635.599833:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001077888 00000100:00100000:2.0:1788658635.599842:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001077888 00000100:00100000:2.0:1788658635.599938:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00100000:2.0:1788658635.599948:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:15024:x1875544001077888:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658635.599965:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658635.599985:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6ff13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccb9a expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.600016:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6ff13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb9a expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.600026:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1eb3390200/0x48e67cc629c6ff13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb9a expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.600035:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390200, rc 0) 00000100:00100000:2.0:1788658635.600117:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:15024:x1875544001077888:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 170us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.600124:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 139 00000100:00100000:0.0:1788658635.602337:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.602409:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001078016 00000100:00100000:1.0:1788658635.602420:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001078016 00000100:00100000:1.0:1788658635.602488:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 140 00000100:00100000:1.0:1788658635.602498:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:15024:x1875544001078016:12345-192.168.202.53@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788658635.602524:0:17156:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788658635.602554:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788658635.602564:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788658635.602568:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788658635.602571:0:17156:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788658635.602573:0:17156:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788658635.607994:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:15024:x1875544001078016:12345-192.168.202.53@tcp:256:mount.lustre.0 Request processed in 5485us (5656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.608010:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 140 00000100:00100000:0.0:1788658635.616321:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.616451:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001078144 00000100:00100000:1.0:1788658635.616463:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001078144 00000100:00100000:1.0:1788658635.616524:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 141 00000100:00100000:1.0:1788658635.616535:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:15024:x1875544001078144:12345-192.168.202.53@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788658635.616552:0:17154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658635.616569:0:17154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccba1 expref: -99 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.616601:0:17154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccba1 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.616615:0:17154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccba1 expref: 13 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658635.616627:0:17154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419800, rc 0) 00000100:00100000:1.0:1788658635.616695:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:15024:x1875544001078144:12345-192.168.202.53@tcp:101:mount.lustre.0 Request processed in 161us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.616743:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 141 00000100:00100000:0.0:1788658635.619636:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.619792:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001078272 00000100:00100000:1.0:1788658635.619815:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001078272 00000100:00100000:1.0:1788658635.619961:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 142 00000100:00100000:1.0:1788658635.619973:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:15024:x1875544001078272:12345-192.168.202.53@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788658635.620143:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:15024:x1875544001078272:12345-192.168.202.53@tcp:501:mount.lustre.0 Request processed in 172us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.620169:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 142 00000100:00100000:0.0:1788658635.624562:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658635.624699:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001078400 00000100:00100000:2.0:1788658635.624734:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001078400 00000100:00100000:2.0:1788658635.624797:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 143 00000100:00100000:2.0:1788658635.624806:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:15024:x1875544001078400:12345-192.168.202.53@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788658635.624972:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:15024:x1875544001078400:12345-192.168.202.53@tcp:503:mount.lustre.0 Request processed in 165us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.624990:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 143 00000100:00100000:0.0:1788658635.629595:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.629959:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001078528 00000100:00100000:1.0:1788658635.629970:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001078528 00000100:00100000:1.0:1788658635.630037:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 144 00000100:00100000:1.0:1788658635.630047:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:15035:x1875544001078528:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658635.630258:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:15035:x1875544001078528:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 211us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.630266:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 144 00000100:00100000:0.0:1788658635.645054:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.650654:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001078656 00000100:00100000:1.0:1788658635.650675:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001078656 00000100:00100000:1.0:1788658635.650810:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 145 00000100:00100000:1.0:1788658635.650824:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:15035:x1875544001078656:12345-192.168.202.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788658635.651024:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:15035:x1875544001078656:12345-192.168.202.53@tcp:502:llog_process_th.0 Request processed in 203us (5979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.651033:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 145 00000100:00100000:0.0:1788658635.666471:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.666962:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001078784 00000100:00100000:1.0:1788658635.666976:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001078784 00000100:00100000:1.0:1788658635.667106:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:1.0:1788658635.667119:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2395:x1875544001078784:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788658635.667157:0:18693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad@192.168.202.53@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:1.0:1788658635.667206:0:18693:0:(genops.c:1385:class_connect()) connect: client dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad, cookie 0x48e67cc629c6ff21 00000004:00100000:1.0:1788658635.667240:0:18693:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788658635.667383:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8a1ebf633800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658635.667490:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2395:x1875544001078784:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 372us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.667515:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:0.0:1788658635.668409:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658635.668935:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001079040 00000100:00100000:2.0:1788658635.668945:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001079040 00000100:00100000:2.0:1788658635.668988:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1788658635.668996:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1875544001079040:12345-192.168.202.53@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788658635.669022:0:17163:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad@192.168.202.53@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:2.0:1788658635.669061:0:17163:0:(genops.c:1385:class_connect()) connect: client dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad, cookie 0x48e67cc629c6ff28 00000004:00100000:2.0:1788658635.669084:0:17163:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788658635.669159:0:17163:0:(import.c:65:import_set_state_nolock()) ffff8a1d810f2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658635.669211:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2395:x1875544001079040:12345-192.168.202.53@tcp:38:mount.lustre.0 Request processed in 215us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.669219:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:0.0:1788658635.679450:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658635.679499:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658635.679659:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001079296 00000100:00100000:3.0:1788658635.679670:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001079296 00000100:00100000:3.0:1788658635.679794:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001078912 00000100:00100000:3.0:1788658635.679798:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001078912 00000100:00100000:3.0:1788658635.679824:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:3.0:1788658635.679834:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+7:15024:x1875544001079296:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658635.679866:0:17162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788658635.679951:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+7:15024:x1875544001079296:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 118us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.679973:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:3.0:1788658635.679993:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:3.0:1788658635.680000:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:0:x1875544001078912:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658635.680013:0:17162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788658635.680035:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:0:x1875544001078912:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 36us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.680041:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00080000:0.0:1788658635.680673:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658635.681564:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658635.681928:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001079168 00000100:00100000:3.0:1788658635.681938:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001079168 00000100:00100000:3.0:1788658635.682011:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:3.0:1788658635.682020:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:0:x1875544001079168:12345-192.168.202.53@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788658635.682044:0:17162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788658635.682107:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:0:x1875544001079168:12345-192.168.202.53@tcp:41:mount.lustre.0 Request processed in 88us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.682115:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00080000:0.0:1788658635.684433:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788658635.691533:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658635.691656:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001079424 00000100:00100000:2.0:1788658635.691667:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001079424 00000100:00100000:2.0:1788658635.691745:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1788658635.691756:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:15024:x1875544001079424:12345-192.168.202.53@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788658635.691975:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:15024:x1875544001079424:12345-192.168.202.53@tcp:40:mount.lustre.0 Request processed in 221us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.691984:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:2.0:1788658635.699333:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658635.699466:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658635.699499:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658635.699693:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001079552 00000100:00100000:0.0:1788658635.699737:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001079552 00000100:00100000:0.0:1788658635.699773:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001079680 00000100:00100000:0.0:1788658635.699777:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001079680 00000100:00100000:0.0:1788658635.699801:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:0.0:1788658635.699809:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875544001079552:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788658635.699848:0:18667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad@192.168.202.53@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:0.0:1788658635.699883:0:18667:0:(genops.c:1385:class_connect()) connect: client dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad, cookie 0x48e67cc629c6ff2f 00002000:00100000:0.0:1788658635.699925:0:18667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad/ffff8a1ec1213800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658635.699936:0:18667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658635.700018:0:18667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788658635.700048:0:18667:0:(import.c:65:import_set_state_nolock()) ffff8a1ec1215800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658635.700112:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2395:x1875544001079552:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 302us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658635.700120:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:0.0:1788658635.700138:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:0.0:1788658635.700143:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1875544001079680:12345-192.168.202.53@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788658635.700159:0:18667:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad@192.168.202.53@tcp t0 exp 0000000000000000 cur 552 last 0 00000020:00000080:0.0:1788658635.700175:0:18667:0:(genops.c:1385:class_connect()) connect: client dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad, cookie 0x48e67cc629c6ff36 00002000:00100000:0.0:1788658635.700180:0:18667:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad/ffff8a1eb5e62000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658635.700187:0:18667:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658635.700234:0:18667:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788658635.700247:0:18667:0:(import.c:65:import_set_state_nolock()) ffff8a1eb5e62800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658635.700268:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2395:x1875544001079680:12345-192.168.202.53@tcp:8:mount.lustre.0 Request processed in 124us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658635.700293:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000001:00100000:2.0:1788658635.707027:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000001:00100000:2.0:1788658635.707044:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f934723f-b66d-409a-bfc9-9b206b383163 00000001:00080000:2.0:1788658635.707069:0:19484:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:3.0:1788658635.709427:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001079808 00000100:00100000:3.0:1788658635.709444:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001079808 00000100:00100000:1.0:1788658635.709788:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:1.0:1788658635.709810:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1ebdb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:15024:x1875544001079808:12345-192.168.202.53@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788658635.709918:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1ebdb3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:15024:x1875544001079808:12345-192.168.202.53@tcp:900:mount.lustre.0 Request processed in 120us (10595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.709926:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1788658635.711130:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025281024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658635.711204:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658635.712231:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658635.712246:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025281152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658635.712299:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658635.712539:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025281024 00000100:00100000:2.0:1788658635.712547:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025281024 00000100:00100000:2.0:1788658635.712600:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025281152 00000100:00100000:2.0:1788658635.712603:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025281152 00000100:00100000:2.0:1788658635.712623:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658635.712632:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025281024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658635.712654:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788658635.712732:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025281024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.712739:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658635.712756:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658635.712764:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025281152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658635.712774:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788658635.712804:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025281152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.712810:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658635.712842:0:3650:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788658635.712863:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025281024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658635.712905:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d834f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025281152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788658635.713245:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025281408:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.713288:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.713317:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025281920:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.713508:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.713526:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025282432:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.713553:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.713576:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788658635.713581:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025281536:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.713600:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.713616:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025282048:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.713633:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.713647:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025282560:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.713680:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.713725:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025281664:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.713748:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.713763:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025282176:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.713783:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.714066:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788658635.714072:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025281280:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.714100:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.714122:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025281792:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.714143:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.714157:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025282304:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.714184:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658635.714206:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025281920 00000100:00100000:1.0:1788658635.714211:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025281920 00000100:00100000:1.0:1788658635.714247:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025281536 00000100:00100000:1.0:1788658635.714249:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025281536 00000100:00100000:1.0:1788658635.714265:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658635.714440:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025281920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.714485:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025281920:12345-0@lo:400:kworker.0 Request processed in 49us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.714492:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788658635.714507:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658635.714512:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025281536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.714538:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025281536:12345-0@lo:400:kworker.0 Request processed in 26us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.714543:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788658635.714579:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025281536:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.714589:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025281920:0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.714614:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025282432 00000100:00100000:1.0:1788658635.714617:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025282432 00000100:00100000:1.0:1788658635.714638:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025282048 00000100:00100000:1.0:1788658635.714648:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025282048 00000100:00100000:1.0:1788658635.714660:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025282560 00000100:00100000:1.0:1788658635.714663:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025282560 00000100:00100000:3.0:1788658635.714775:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025281408 00000100:00100000:3.0:1788658635.714779:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025281408 00000100:00100000:3.0:1788658635.714803:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025281792 00000100:00100000:3.0:1788658635.714805:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025281792 00000100:00100000:3.0:1788658635.714817:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658635.714824:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025281408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.714865:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025281408:12345-0@lo:400:kworker.0 Request processed in 42us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.714870:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658635.714889:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788658635.714906:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025281792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.714938:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025281792:12345-0@lo:400:kworker.0 Request processed in 33us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.714944:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788658635.714970:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025281792:0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.714994:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025281408:0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.715010:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025281664 00000100:00100000:3.0:1788658635.715013:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025281664 00000100:00100000:3.0:1788658635.715027:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025282176 00000100:00100000:3.0:1788658635.715030:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025282176 00000100:00100000:3.0:1788658635.715040:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025282304 00000100:00100000:3.0:1788658635.715042:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025282304 00000100:00100000:3.0:1788658635.715056:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788658635.715061:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025282432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.715091:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875544025282432:12345-0@lo:400:kworker.0 Request processed in 30us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.715097:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788658635.715107:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788658635.715112:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025282048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.715136:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875544025282048:12345-0@lo:400:kworker.0 Request processed in 24us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.715140:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788658635.715149:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788658635.715154:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025281664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.715534:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875544025281664:12345-0@lo:400:kworker.0 Request processed in 378us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.715546:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788658635.715558:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788658635.715564:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025282176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.715593:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875544025282176:12345-0@lo:400:kworker.0 Request processed in 30us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.715599:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788658635.715609:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788658635.715614:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025282304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.715638:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875544025282304:12345-0@lo:400:kworker.0 Request processed in 24us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658635.715644:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788658635.715762:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e84430380 x1875544025282304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658635.715775:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875544025282304:0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.715789:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875544025281664:0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.715798:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875544025282176:0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.715824:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875544025282048:0@lo:400:kworker.0 00000100:00100000:3.0:1788658635.715834:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875544025282432:0@lo:400:kworker.0 00000100:00100000:2.0:1788658635.715958:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025281280 00000100:00100000:2.0:1788658635.715963:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025281280 00000100:00100000:2.0:1788658635.716002:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788658635.716010:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3647:x1875544025281280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658635.716051:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3647:x1875544025281280:12345-0@lo:400:kworker.0 Request processed in 43us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.716057:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788658635.716166:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658635.716173:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025282560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658635.716206:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875544025282560:12345-0@lo:400:kworker.0 Request processed in 33us (2525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.716212:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788658635.716298:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658635.716303:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658635.716306:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788658635.716308:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658635.716489:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025281280:0@lo:400:kworker.0 00010000:00080000:3.0:1788658635.716517:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1e84431f80 x1875544025282560/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658635.716527:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875544025282560:0@lo:400:kworker.0 00000100:00100000:2.0:1788658635.719997:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658635.720161:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001079936 00000100:00100000:1.0:1788658635.720171:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001079936 00000100:00100000:1.0:1788658635.720446:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:1.0:1788658635.720457:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:15024:x1875544001079936:12345-192.168.202.53@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788658635.720540:0:17166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788658635.720664:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d834f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:15024:x1875544001079936:12345-192.168.202.53@tcp:33:mount.lustre.0 Request processed in 209us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658635.720680:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00010000:00010000:3.0:1788658635.839086:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658635.909622:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658635.912535:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001080064 00000100:00100000:2.0:1788658635.912551:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001080064 00000100:00100000:2.0:1788658635.912627:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:2.0:1788658635.912636:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:15058:x1875544001080064:12345-192.168.202.53@tcp:101:mkdir.0 00010000:00010000:2.0:1788658635.912656:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658635.912683:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ff3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccbd2 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.912785:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.912799:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.912815:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658635.912869:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788658635.912872:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658635.912921:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.912947:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ff3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd2 expref: 8 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.912985:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd2 expref: 7 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658635.912995:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35c7400) 00010000:00010000:2.0:1788658635.912998:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658635.913002:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391e00, rc 0) 00000100:00100000:2.0:1788658635.913065:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+7:15058:x1875544001080064:12345-192.168.202.53@tcp:101:mkdir.0 Request processed in 430us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658635.913072:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:1.0:1788658636.735545:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025282688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658636.735619:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658636.735868:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025282688 00000100:00100000:2.0:1788658636.735887:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025282688 00000100:00100000:2.0:1788658636.735951:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658636.735962:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025282688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788658636.735987:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788658636.745660:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025282688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9688us (10028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658636.745679:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658636.748307:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025282688:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788658636.862992:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658637.759344:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658637.759369:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025282816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658637.759438:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658637.759644:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025282816 00000100:00100000:0.0:1788658637.759651:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025282816 00000100:00080000:2.0:1788658637.759694:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658637.759725:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788658637.759736:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025282816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658637.759766:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788658637.759863:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025282816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658637.759869:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658637.760694:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025282816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788658637.887319:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658638.271049:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788658638.271087:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025282944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658638.271164:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658638.271222:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025282944 00000100:00100000:1.0:1788658638.271230:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025282944 00000100:00100000:1.0:1788658638.271276:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788658638.271287:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025282944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788658638.271323:0:17167:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788658638.271371:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025282944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658638.271378:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788658638.271423:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025282944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658638.273741:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658638.274143:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025283072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658638.274218:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658638.274342:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025283072 00000100:00100000:2.0:1788658638.274351:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025283072 00000100:00100000:2.0:1788658638.274434:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788658638.274445:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025283072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788658638.274484:0:18107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788658638.274547:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875544025283072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658638.274792:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788658638.274877:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83670700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875544025283072:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788658638.800188:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000001:00100000:1.0:1788658638.800206:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f934723f-b66d-409a-bfc9-9b206b383163 00000001:00100000:1.0:1788658638.803000:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000001:00100000:1.0:1788658638.803014:0:17142:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f934723f-b66d-409a-bfc9-9b206b383163 00000001:00100000:2.0:1788658638.803102:0:17894:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad 00000001:00100000:2.0:1788658638.803110:0:17894:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f934723f-b66d-409a-bfc9-9b206b383163 00010000:00010000:3.0:1788658638.916075:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658639.173122:0:20038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788658639.935469:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658640.512632:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788658640.831935:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025283200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658640.832031:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.832110:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658640.832117:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025283328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658640.832143:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.832187:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025283200 00000100:00100000:2.0:1788658640.832196:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025283200 00000100:00100000:2.0:1788658640.832251:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025283328 00000100:00100000:2.0:1788658640.832255:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025283328 00000100:00100000:2.0:1788658640.832273:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658640.832283:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025283200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658640.832334:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788658640.832390:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025283200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.832399:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658640.832416:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788658640.832422:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025283328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658640.832433:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788658640.832457:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025283328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.832463:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788658640.832485:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658640.832541:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025283328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658640.832555:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025283200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658640.833027:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025283584:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833063:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.833095:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025284096:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833118:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.833138:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025284608:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833166:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.833188:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788658640.833194:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025283456:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833222:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.833253:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025283968:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833277:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.833297:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025284480:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833333:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.833365:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025283584 00000100:00100000:2.0:1788658640.833370:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025283584 00000100:00100000:2.0:1788658640.833407:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025283968 00000100:00100000:2.0:1788658640.833411:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025283968 00000100:00100000:2.0:1788658640.833428:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788658640.833435:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025283584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833480:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025283584:12345-0@lo:400:kworker.0 Request processed in 46us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.833487:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788658640.833499:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788658640.833515:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025283968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833545:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025283968:12345-0@lo:400:kworker.0 Request processed in 31us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.833551:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788658640.833573:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025284096 00000100:00100000:2.0:1788658640.833576:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025284096 00000100:00100000:2.0:1788658640.833748:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658640.833757:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025284096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833788:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025284096:12345-0@lo:400:kworker.0 Request processed in 34us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.833794:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658640.833812:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025284608 00000100:00100000:2.0:1788658640.833815:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025284608 00000100:00100000:2.0:1788658640.833843:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025284480 00000100:00100000:2.0:1788658640.833846:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025284480 00000100:00100000:2.0:1788658640.833865:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788658640.833872:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025284608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833903:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875544025284608:12345-0@lo:400:kworker.0 Request processed in 32us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.833909:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788658640.833919:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788658640.833925:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025284480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.833951:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025284480:12345-0@lo:400:kworker.0 Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.833957:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788658640.833996:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025283840:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.834034:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.834053:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025284352:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.834074:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.834093:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788658640.834100:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025283712:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.834120:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.834135:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025284224:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.834155:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.834169:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025284736:0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.834190:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658640.834214:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025283712 00000100:00100000:2.0:1788658640.834217:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025283712 00000100:00100000:2.0:1788658640.834246:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658640.834252:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025283712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.834288:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025283712:12345-0@lo:400:kworker.0 Request processed in 35us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.834293:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658640.834327:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025283840 00000100:00100000:2.0:1788658640.834330:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025283840 00000100:00100000:2.0:1788658640.834345:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025284352 00000100:00100000:2.0:1788658640.834347:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025284352 00000100:00100000:2.0:1788658640.834359:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025284224 00000100:00100000:2.0:1788658640.834361:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025284224 00000100:00100000:2.0:1788658640.834372:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025284736 00000100:00100000:2.0:1788658640.834374:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025284736 00000100:00100000:2.0:1788658640.834388:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788658640.834393:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025283840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.834435:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875544025283840:12345-0@lo:400:kworker.0 Request processed in 41us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.834442:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788658640.834453:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788658640.834459:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025284352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.834484:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875544025284352:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.834489:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788658640.834500:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788658640.834505:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025284224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.834531:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875544025284224:12345-0@lo:400:kworker.0 Request processed in 26us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.834536:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788658640.834548:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658640.834554:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025284736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658640.834577:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875544025284736:12345-0@lo:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658640.834582:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788658640.835400:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025283456 00000100:00100000:3.0:1788658640.835412:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025283456 00000100:00100000:3.0:1788658640.835464:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788658640.835473:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3650:x1875544025283456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658640.835546:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3650:x1875544025283456:12345-0@lo:400:kworker.0 Request processed in 75us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658640.835554:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1788658640.835877:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658640.835883:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658640.835887:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658640.835934:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025283456:0@lo:400:kworker.0 00000100:00100000:3.0:1788658640.835956:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025283968:0@lo:400:kworker.0 00010000:00080000:3.0:1788658640.835977:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eadba2a00 x1875544025284480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658640.835990:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025284480:0@lo:400:kworker.0 00000100:00100000:3.0:1788658640.836004:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025283584:0@lo:400:kworker.0 00000100:00100000:3.0:1788658640.836018:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025284096:0@lo:400:kworker.0 00000100:00100000:3.0:1788658640.836030:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875544025284608:0@lo:400:kworker.0 00000100:00100000:3.0:1788658640.836098:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025283712:0@lo:400:kworker.0 00000100:00100000:3.0:1788658640.836128:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875544025284224:0@lo:400:kworker.0 00010000:00080000:3.0:1788658640.836140:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eadba0380 x1875544025284736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658640.836150:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875544025284736:0@lo:400:kworker.0 00000100:00100000:3.0:1788658640.836161:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875544025283840:0@lo:400:kworker.0 00000100:00100000:3.0:1788658640.836173:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875544025284352:0@lo:400:kworker.0 00010000:00010000:3.0:1788658640.958944:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658641.086850:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658641.086902:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658641.086933:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658641.086967:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658641.087008:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658641.087031:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658641.087073:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658641.087090:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658641.087112:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658641.087146:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001080576 00000100:00100000:0.0:1788658641.087158:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001080576 00000100:00100000:0.0:1788658641.087227:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001081088 00000100:00100000:0.0:1788658641.087231:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001081088 00000100:00100000:0.0:1788658641.087245:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001080704 00000100:00100000:0.0:1788658641.087248:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001080704 00000100:00100000:0.0:1788658641.087261:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001081216 00000100:00100000:0.0:1788658641.087264:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001081216 00000100:00100000:0.0:1788658641.087282:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:0.0:1788658641.087293:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001080576:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658641.087395:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001080576:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 103us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658641.087404:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:0.0:1788658641.087426:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1788658641.087433:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001081088:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658641.087459:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001081088:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658641.087466:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 11 00000100:00100000:0.0:1788658641.087480:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:0.0:1788658641.087486:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001080704:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658641.087510:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001080704:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658641.087516:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 12 00000100:00100000:0.0:1788658641.087537:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:0.0:1788658641.087543:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001081216:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658641.087569:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001081216:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658641.087576:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:0.0:1788658641.087596:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001080192 00000100:00100000:0.0:1788658641.087600:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001080192 00000100:00100000:0.0:1788658641.087631:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 148 00000100:00100000:0.0:1788658641.087638:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2397:x1875544001080192:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658641.087663:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2397:x1875544001080192:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 27us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658641.087669:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 148 00000100:00100000:0.0:1788658641.087700:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001080320 00000100:00100000:0.0:1788658641.087755:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001080320 00000100:00100000:0.0:1788658641.087782:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001080832 00000100:00100000:0.0:1788658641.087785:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001080832 00000100:00100000:0.0:1788658641.087797:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001080448 00000100:00100000:0.0:1788658641.087799:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001080448 00000100:00100000:0.0:1788658641.087810:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001080960 00000100:00100000:0.0:1788658641.087813:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001080960 00000100:00100000:0.0:1788658641.087826:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:0.0:1788658641.087832:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+6:2397:x1875544001080320:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658641.087862:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+6:2397:x1875544001080320:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 30us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658641.087869:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:0.0:1788658641.087882:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:0.0:1788658641.087888:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2397:x1875544001080832:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658641.087922:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2397:x1875544001080832:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 34us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658641.087929:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:0.0:1788658641.087941:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:0.0:1788658641.087946:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001080448:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658641.087970:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001080448:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658641.087976:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:0.0:1788658641.087987:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:0.0:1788658641.087993:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001080960:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658641.088010:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001080960:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 18us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658641.088017:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00080000:0.0:1788658641.088034:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788658641.088039:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658641.088041:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658641.088044:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658641.858940:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025284864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658641.859028:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658641.859099:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025284864 00000100:00100000:1.0:1788658641.859109:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025284864 00000100:00100000:1.0:1788658641.859170:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658641.859181:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025284864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788658641.859218:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788658641.859268:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025284864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658641.859275:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788658641.859331:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025284864:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788658641.986981:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788658642.681024:0:20186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeda18c6a0 20000000:00000080:3.0:1788658642.681050:0:20186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a1ec120a800 uarg=0000000000000000 20000000:01000000:3.0:1788658642.681113:0:20186:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788658642.681121:0:20186:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788658642.681127:0:20186:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788658642.682139:0:20187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788658642.683942:0:20186:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788658642.695222:0:20186:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788658642.695523:0:20186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695553:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b97000/0x48e67cc629c6fbe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fbd9 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695563:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e82b96200/0x48e67cc629c6fbee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fbe7 expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695591:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fc2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fc26 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695599:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6fd92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6fd8b expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695611:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6fedb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb31 expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695619:0:20186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccba1 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695628:0:20186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695691:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccba1 expref: 12 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695754:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccba1 expref: 12 pid: 17154 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.695776:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025284992:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658642.695904:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6fedb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb31 expref: 12 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695913:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6fedb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb31 expref: 12 pid: 17156 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.695923:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025285120:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658642.695964:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6fd92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fd8b expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.695971:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6fd92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fd8b expref: 23 pid: 17157 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.695979:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025285248:0@lo:104: 00000100:00100000:2.0:1788658642.696027:0:20186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658642.696066:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fc2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fc26 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.696072:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fc2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fc26 expref: 23 pid: 17156 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.696078:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025285376:0@lo:104: 00000100:00100000:2.0:1788658642.696092:0:20186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658642.696103:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b96200/0x48e67cc629c6fbee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fbe7 expref: 23 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.696108:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e82b96200/0x48e67cc629c6fbee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fbe7 expref: 23 pid: 17157 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.696114:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eadba2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025285504:0@lo:104: 00000100:00100000:2.0:1788658642.696128:0:20186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658642.696144:0:20186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a1e82b97000/0x48e67cc629c6fbe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x48e67cc629c6fbd9 expref: 23 pid: 17154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.696152:0:20186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a1e82b97000/0x48e67cc629c6fbe0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x48e67cc629c6fbd9 expref: 23 pid: 17154 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.696173:0:20186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025285632:0@lo:104: 00000100:00100000:2.0:1788658642.696189:0:20186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658642.696197:0:20186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d81ad0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788658642.696297:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025285248 00000100:00100000:1.0:1788658642.696312:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025285248 00000100:00100000:1.0:1788658642.696361:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025285376 00000100:00100000:1.0:1788658642.696364:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025285376 00000100:00100000:1.0:1788658642.696374:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025285504 00000100:00100000:1.0:1788658642.696377:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025285504 00000100:00100000:1.0:1788658642.696387:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025285632 00000100:00100000:1.0:1788658642.696389:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025285632 00000100:00100000:1.0:1788658642.696402:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658642.696411:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+6:20186:x1875544025285248:12345-0@lo:104: 00010000:00010000:1.0:1788658642.696427:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696508:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658642.696516:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+6:20186:x1875544025285248:12345-0@lo:104: Request processed in 105us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658642.696522:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658642.696539:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658642.696543:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+5:20186:x1875544025285376:12345-0@lo:104: 00010000:00010000:1.0:1788658642.696550:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696594:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788658642.696599:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+5:20186:x1875544025285376:12345-0@lo:104: Request processed in 55us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658642.696605:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658642.696620:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658642.696626:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+4:20186:x1875544025285504:12345-0@lo:104: 00010000:00010000:1.0:1788658642.696633:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696666:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788658642.696669:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eadba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+4:20186:x1875544025285504:12345-0@lo:104: Request processed in 45us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658642.696673:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658642.696682:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658642.696685:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:20186:x1875544025285632:12345-0@lo:104: 00010000:00010000:1.0:1788658642.696691:0:17146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696723:0:17146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788658642.696726:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:913293d7-fe00-4834-a4c1-1b0cae17d59a+3:20186:x1875544025285632:12345-0@lo:104: Request processed in 41us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658642.696730:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788658642.696745:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788658642.696751:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696756:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ec2044000 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658642.696761:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696771:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658642.696779:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658642.696785:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788658642.696825:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696831:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658642.696849:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696854:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1ec2044000/0x48e67cc629c6fd8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fd92 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696865:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788658642.696867:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696871:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97c00 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658642.696873:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696877:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658642.696881:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658642.696883:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788658642.696891:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696894:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658642.696897:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696908:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e82b97c00/0x48e67cc629c6fc26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fc2d expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696914:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788658642.696916:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696919:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670600 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658642.696921:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696926:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658642.696929:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658642.696932:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788658642.696939:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696942:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658642.696952:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696955:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1e81670600/0x48e67cc629c6fbe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbee expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696961:0:17150:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658642.696966:0:17150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696972:0:17150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1d834a1800 already unused, calling callback (ffffffffc116ac20) 10000000:00010000:1.0:1788658642.696975:0:17150:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.696982:0:17150:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788658642.696988:0:17150:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658642.696993:0:17150:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788658642.697007:0:17150:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697012:0:17150:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658642.697019:0:17150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697024:0:17150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.153@tcp lock: ffff8a1d834a1800/0x48e67cc629c6fbd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x48e67cc629c6fbe0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697040:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658642.697042:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658642.697043:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658642.697065:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025285760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658642.697101:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658642.697135:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658642.697140:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025285888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658642.697169:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658642.697198:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025286016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658642.697221:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658642.697241:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658642.697246:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025286144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658642.697266:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658642.697297:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025285760 00000100:00100000:1.0:1788658642.697302:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025285760 00010000:00010000:1.0:1788658642.697324:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6fd92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fd8b expref: 24 pid: 17157 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658642.697341:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025285888 00000100:00100000:1.0:1788658642.697344:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025285888 00010000:00010000:1.0:1788658642.697355:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fc2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fc26 expref: 25 pid: 17156 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658642.697365:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025286016 00000100:00100000:1.0:1788658642.697367:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025286016 00010000:00010000:1.0:1788658642.697376:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b96200/0x48e67cc629c6fbee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fbe7 expref: 26 pid: 17157 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658642.697386:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025286144 00000100:00100000:1.0:1788658642.697388:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025286144 00010000:00010000:1.0:1788658642.697399:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1e82b97000/0x48e67cc629c6fbe0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fbd9 expref: 27 pid: 17154 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658642.697410:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658642.697416:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+27:3649:x1875544025285760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658642.697428:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658642.697440:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6fd92 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fd8b expref: 27 pid: 17157 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697452:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6fd92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fd8b expref: 27 pid: 17157 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697484:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658642.697514:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+27:3649:x1875544025285760:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658642.697521:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658642.697536:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658642.697542:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+26:3649:x1875544025285888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658642.697551:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658642.697554:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fc2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fc26 expref: 26 pid: 17156 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697560:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fc2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fc26 expref: 26 pid: 17156 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697566:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658642.697582:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+26:3649:x1875544025285888:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658642.697586:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658642.697598:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658642.697604:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+25:3647:x1875544025286016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658642.697612:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658642.697616:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b96200/0x48e67cc629c6fbee lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fbe7 expref: 25 pid: 17157 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697637:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b96200/0x48e67cc629c6fbee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fbe7 expref: 25 pid: 17157 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697647:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658642.697672:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+25:3647:x1875544025286016:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658642.697677:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658642.697687:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658642.697691:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3647:x1875544025286144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658642.697696:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658642.697699:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1e82b97000/0x48e67cc629c6fbe0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x48e67cc629c6fbd9 expref: 24 pid: 17154 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697724:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1e82b97000/0x48e67cc629c6fbe0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x48e67cc629c6fbd9 expref: 24 pid: 17154 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.697731:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658642.697744:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3647:x1875544025286144:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658642.697748:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658642.697789:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025285888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658642.697799:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:913293d7-fe00-4834-a4c1-1b0cae17d59a:3649:1875544025285760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658642.697828:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025286144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658642.697832:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025286016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658642.698108:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658642.698656:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391a00/0x48e67cc629c6fd92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fd8b expref: 23 pid: 17157 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.698672:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025285248:0@lo:104: 00010000:00010000:2.0:1788658642.698682:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e81670e00/0x48e67cc629c6fc2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fc26 expref: 22 pid: 17156 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.698690:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025285376:0@lo:104: 00010000:00010000:2.0:1788658642.698737:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b96200/0x48e67cc629c6fbee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fbe7 expref: 21 pid: 17157 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.698748:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025285504:0@lo:104: 00010000:00010000:2.0:1788658642.698760:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1e82b97000/0x48e67cc629c6fbe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x48e67cc629c6fbd9 expref: 20 pid: 17154 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.698769:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025285632:0@lo:104: 00000100:00100000:2.0:1788658642.702879:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025284992:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658642.702879:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658642.702895:0:20186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eadba1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20186:1875544025285120:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658642.702950:0:20186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658642.703017:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658642.704390:0:18316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001081472 00000100:00100000:1.0:1788658642.704390:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001081344 00000100:00100000:2.0:1788658642.704408:0:18316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001081472 00000100:00100000:1.0:1788658642.704414:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001081344 00010000:00010000:1.0:1788658642.704462:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccba1 expref: 14 pid: 17154 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.704463:0:18316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6fedb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb31 expref: 14 pid: 17156 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.704519:0:18316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 13 00000100:00100000:2.0:1788658642.704585:0:18316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eabc41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67137b4e-5d5d-4374-acb2-2bfe6af790cf+14:2397:x1875544001081344:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658642.704606:0:18316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658642.704613:0:18316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccba1 expref: 14 pid: 17154 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.704627:0:18316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccba1 expref: 14 pid: 17154 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.704648:0:18316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccba1 expref: 14 pid: 17154 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.704666:0:18316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658642.704799:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:1.0:1788658642.704809:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2397:x1875544001081472:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658642.704818:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658642.704823:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6fedb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb31 expref: 13 pid: 17156 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704831:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6fedb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb31 expref: 13 pid: 17156 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704841:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6fedb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb31 expref: 13 pid: 17156 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704852:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704861:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658642.704870:0:18316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eabc41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:2397:x1875544001081344:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 288us (2000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658642.704879:0:18316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 13 00010000:00010000:1.0:1788658642.704879:0:17149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704886:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704893:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704909:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704916:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:1.0:1788658642.704921:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704930:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704946:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658642.704958:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658642.704961:0:20186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.704970:0:20186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658642.704977:0:20186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a1eb3391400/0x48e67cc629c6ff4b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658642.704979:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:2397:x1875544001081472:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 172us (1962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658642.704985:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 14 00000100:00100000:1.0:1788658642.884445:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025286272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658642.884565:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658642.885379:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025286272 00000100:00100000:3.0:1788658642.885395:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025286272 00000100:00100000:3.0:1788658642.885482:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658642.885509:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025286272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658642.885543:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788658642.886289:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658642.905523:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025286272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 20020us (20948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658642.905542:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658642.906212:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025286272:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788658643.010216:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658643.390852:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658643.390882:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025286400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788658643.390960:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658643.391078:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025286400 00000100:00100000:0.0:1788658643.391097:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025286400 00000100:00100000:0.0:1788658643.391146:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788658643.391163:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025286400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658643.391199:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788658643.391234:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658643.391245:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025286528:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788658643.391248:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025286400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658643.391254:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788658643.391289:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658643.391332:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025286400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788658643.391419:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025286528 00000100:00100000:0.0:1788658643.391424:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025286528 00000100:00100000:0.0:1788658643.391615:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788658643.391624:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025286528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658643.391645:0:18107:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788658643.391681:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025286528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658643.391687:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788658643.393504:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025286528:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788658644.031974:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788658644.222966:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788658644.222980:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1eb4839000 from 13 10000000:01000000:1.0:1788658644.222987:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658644.223030:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.223042:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.223053:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658644.223078:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025286656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.223150:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658644.223201:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658644.223364:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025286656 00000100:00100000:0.0:1788658644.223372:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025286656 00000100:00100000:0.0:1788658644.223423:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788658644.223433:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+20:17159:x1875544025286656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658644.223447:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658644.223462:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ebf603e00/0x48e67cc629c6ff59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6ff52 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658644.223486:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf603e00/0x48e67cc629c6ff59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6ff52 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658644.223497:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ebf603e00/0x48e67cc629c6ff59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6ff52 expref: 21 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658644.223517:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf603e00, rc 0) 00000100:00100000:0.0:1788658644.223566:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:17159:x1875544025286656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658644.223574:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788658644.225822:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025286656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658644.225850:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.225863:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658644.225963:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025286784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.226023:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658644.226059:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658644.226079:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025286784 00000100:00100000:1.0:1788658644.226084:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025286784 00000100:00100000:1.0:1788658644.226122:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788658644.226130:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:17159:x1875544025286784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.226251:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:17159:x1875544025286784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658644.226269:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788658644.226308:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025286784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.226335:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025286912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.226373:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658644.226387:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebd8a70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658644.226399:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025286912 00000100:00100000:1.0:1788658644.226402:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025286912 00000100:00100000:1.0:1788658644.226422:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788658644.226428:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:17159:x1875544025286912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.226499:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:17159:x1875544025286912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658644.226507:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788658644.226568:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025286912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788658644.227297:0:20269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788658644.227366:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788658644.227388:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788658644.227398:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.227409:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d83419000/0x48e67cc629c6ff52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff59 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658644.227419:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788658644.227422:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1e88e5d000 from 13 10000000:01000000:1.0:1788658644.227425:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658644.227456:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.227471:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.227482:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658644.227499:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.227539:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658644.227558:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658644.227576:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025287040 00000100:00100000:1.0:1788658644.227581:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025287040 00000100:00100000:1.0:1788658644.227609:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788658644.227632:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+21:17159:x1875544025287040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658644.227646:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658644.227661:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83418a00/0x48e67cc629c6ff67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6ff60 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.227681:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83418a00/0x48e67cc629c6ff67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6ff60 expref: 22 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.227691:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83418a00/0x48e67cc629c6ff67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6ff60 expref: 22 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.227700:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418a00, rc 0) 00000100:00100000:1.0:1788658644.227756:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:17159:x1875544025287040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658644.227762:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788658644.227810:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658644.227823:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.227832:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658644.227877:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.227902:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658644.227914:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658644.227926:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025287168 00000100:00100000:1.0:1788658644.227929:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025287168 00000100:00100000:1.0:1788658644.227947:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788658644.227953:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e9178a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:17159:x1875544025287168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.228042:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e9178a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:17159:x1875544025287168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658644.228049:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788658644.228076:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.228099:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.228134:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658644.228148:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658644.228158:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025287296 00000100:00100000:1.0:1788658644.228162:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025287296 00000100:00100000:1.0:1788658644.228182:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788658644.228189:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e91789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:17159:x1875544025287296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.228257:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e91789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:17159:x1875544025287296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658644.228270:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788658644.228306:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658644.239223:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658644.239266:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001081600 00000100:00100000:3.0:1788658644.239275:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001081600 00000100:00100000:3.0:1788658644.239325:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 155 00000100:00100000:3.0:1788658644.239334:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+11:14906:x1875544001081600:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658644.239353:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658644.239372:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ff6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccbd9 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658644.239402:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ff6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd9 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658644.239415:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1e82b96e00/0x48e67cc629c6ff6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd9 expref: 12 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658644.239424:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96e00, rc 0) 00000100:00100000:3.0:1788658644.239491:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83634c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:14906:x1875544001081600:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 157us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658644.239498:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 155 00000040:00080000:1.0:1788658644.240271:0:20270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788658644.240364:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788658644.240386:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788658644.240396:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.240407:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d83418e00/0x48e67cc629c6ff60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff67 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658644.240419:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788658644.240422:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1e82c42000 from 13 10000000:01000000:1.0:1788658644.240425:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788658644.240461:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.240468:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.240478:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658644.240501:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.242969:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658644.243025:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205180 going to sleep for 11 seconds 00000100:00100000:1.0:1788658644.243050:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025287424 00000100:00100000:1.0:1788658644.243057:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025287424 00000100:00100000:1.0:1788658644.243119:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788658644.243128:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+22:17159:x1875544025287424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658644.243143:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658644.243161:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6ff75 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.243189:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6ff75 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.243202:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83419800/0x48e67cc629c6ff7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6ff75 expref: 23 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.243212:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83419800, rc 0) 00000100:00100000:1.0:1788658644.243267:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83636450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:17159:x1875544025287424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658644.243274:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788658644.243320:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658644.243340:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.243350:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658644.246239:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.246331:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658644.246826:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025287552 00000100:00100000:0.0:1788658644.246834:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025287552 00000100:00100000:0.0:1788658644.246880:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788658644.246887:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:17159:x1875544025287552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658644.247026:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83637c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:17159:x1875544025287552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658644.247031:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788658644.247698:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205180 going to sleep for 11 seconds 00000100:00100000:1.0:1788658644.247739:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.247797:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.247843:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658644.247873:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205180 going to sleep for 11 seconds 00000100:00100000:2.0:1788658644.248164:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025287680 00000100:00100000:2.0:1788658644.248169:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025287680 00000100:00100000:2.0:1788658644.248219:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788658644.248226:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:17159:x1875544025287680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658644.248325:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83637850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:17159:x1875544025287680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658644.248332:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788658644.249135:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788658644.251992:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:0.0:1788658644.252296:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000020:01000000:2.0:1788658644.252356:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788658644.252383:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658644.252394:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658644.252405:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1d83419200/0x48e67cc629c6ff75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff7c expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658644.252414:0:17159:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658644.252417:0:17159:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a1eb751f000 from 13 10000000:01000000:2.0:1788658644.252420:0:17159:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658644.252456:0:17159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658644.252463:0:17159:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658644.252473:0:17159:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658644.252497:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658644.252555:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658644.252680:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc6119c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658644.252858:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001081728 00000100:00100000:0.0:1788658644.252867:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001081728 00000100:00100000:0.0:1788658644.252986:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025287808 00000100:00100000:0.0:1788658644.252990:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025287808 00000100:00100000:0.0:1788658644.253012:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:0.0:1788658644.253022:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:14906:x1875544001081728:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658644.253179:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83635450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:14906:x1875544001081728:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 157us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658644.253189:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 159 00000100:00100000:0.0:1788658644.253219:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788658644.253225:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+23:17159:x1875544025287808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658644.253235:0:17157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658644.253266:0:17157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1ebf602200/0x48e67cc629c6ff8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x48e67cc629c6ff83 expref: -99 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658644.253291:0:17157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1ebf602200/0x48e67cc629c6ff8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x48e67cc629c6ff83 expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658644.253302:0:17157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1ebf602200/0x48e67cc629c6ff8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x48e67cc629c6ff83 expref: 24 pid: 17157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658644.253312:0:17157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602200, rc 0) 00000100:00100000:0.0:1788658644.253344:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83635050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:17159:x1875544025287808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658644.253351:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788658644.253815:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658644.253841:0:17159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658644.253851:0:17159:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658644.253927:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658644.253960:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658644.253986:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc6119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658644.254000:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025287936 00000100:00100000:2.0:1788658644.254004:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025287936 00000100:00100000:2.0:1788658644.254030:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788658644.254036:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:17159:x1875544025287936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658644.254138:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:17159:x1875544025287936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658644.254146:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788658644.254174:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025287936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658644.254201:0:17159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025288064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658644.254240:0:17159:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658644.254253:0:17159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc6119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658644.254265:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025288064 00000100:00100000:2.0:1788658644.254268:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025288064 00000100:00100000:2.0:1788658644.254289:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788658644.254295:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:17159:x1875544025288064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658644.254365:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:17159:x1875544025288064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658644.254379:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788658644.254416:0:17159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:913293d7-fe00-4834-a4c1-1b0cae17d59a:17159:1875544025288064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788658644.256670:0:20272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788658644.256999:0:17159:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788658644.257025:0:17159:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.153@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658644.257038:0:17159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658644.257051:0:17159:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.153@tcp lock: ffff8a1eb3391c00/0x48e67cc629c6ff83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x48e67cc629c6ff8a expref: -99 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658644.261974:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658644.262076:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001081856 00000100:00100000:3.0:1788658644.262089:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001081856 00000100:00100000:3.0:1788658644.262156:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 163 00000100:00100000:3.0:1788658644.262168:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:14906:x1875544001081856:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658644.262315:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:14906:x1875544001081856:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 149us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658644.262324:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 163 00000100:00100000:3.0:1788658644.270328:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658644.270429:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001081984 00000100:00100000:1.0:1788658644.270443:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001081984 00000100:00100000:1.0:1788658644.270511:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:1.0:1788658644.270524:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+12:14906:x1875544001081984:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658644.270544:0:17156:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658644.270569:0:17156:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6ff91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccbe0 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.270628:0:17156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6ff91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbe0 expref: 13 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.270642:0:17156:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a1d83418000/0x48e67cc629c6ff91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbe0 expref: 13 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658644.270653:0:17156:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1d83418000, rc 0) 00000100:00100000:1.0:1788658644.271194:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:14906:x1875544001081984:12345-192.168.202.53@tcp:101:ll_cfg_requeue.0 Request processed in 671us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658644.271204:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 164 00000100:00100000:1.0:1788658644.274400:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658644.274521:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001082112 00000100:00100000:2.0:1788658644.274532:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001082112 00000100:00100000:2.0:1788658644.274729:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 165 00000100:00100000:2.0:1788658644.274742:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:14906:x1875544001082112:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658644.274909:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:14906:x1875544001082112:12345-192.168.202.53@tcp:501:ll_cfg_requeue.0 Request processed in 169us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658644.274917:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 165 00000100:00100000:3.0:1788658644.278417:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658644.278486:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001082240 00000100:00100000:1.0:1788658644.278494:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001082240 00000100:00100000:1.0:1788658644.278546:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 166 00000100:00100000:1.0:1788658644.278564:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:14906:x1875544001082240:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658644.278781:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:14906:x1875544001082240:12345-192.168.202.53@tcp:503:ll_cfg_requeue.0 Request processed in 217us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658644.278790:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 166 00010000:00010000:1.0:1788658645.055529:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658645.247461:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788658645.898735:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658645.898963:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001082368 00000100:00100000:0.0:1788658645.898972:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001082368 00000100:00100000:0.0:1788658645.899036:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:0.0:1788658645.899044:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+6:15574:x1875544001082368:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658645.899061:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658645.899079:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ff98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccbe7 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899158:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c6ff9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899184:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c6ff9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899198:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c6ff9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899210:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6ffa6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899214:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6ffa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899219:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6ffa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899318:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c6ffad lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899326:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c6ffad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899332:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c6ffad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658645.899364:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788658645.899368:0:17162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658645.899407:0:17162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c6ffad lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899430:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c6ff9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899436:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c6ff9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899443:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c6ff9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899449:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658645.899453:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c6ff9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899461:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c6ff9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899473:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35c7400) 00010000:00010000:0.0:1788658645.899475:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658645.899480:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c6ff9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899486:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c6ff9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899500:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6ffa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899507:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6ffa6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899512:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6ffa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899523:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658645.899526:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6ffa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899532:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6ffa6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899539:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a1e90e70c00) 00010000:00010000:0.0:1788658645.899541:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:2.0:1788658645.899778:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788658645.899860:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6ffa6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899867:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6ffa6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899907:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ff98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbe7 expref: 8 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899920:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602a00/0x48e67cc629c6ffad lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbe7 expref: 7 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658645.899927:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:0.0:1788658645.899930:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658645.899932:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602a00, rc 0) 00000100:00100000:0.0:1788658645.899999:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+7:15574:x1875544001082368:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 955us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658645.900005:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:2.0:1788658645.910023:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658645.910171:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001082496 00000100:00100000:0.0:1788658645.910196:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001082496 00000100:00100000:0.0:1788658645.910254:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:0.0:1788658645.910272:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f934723f-b66d-409a-bfc9-9b206b383163+7:15574:x1875544001082496:12345-192.168.202.53@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788658645.910371:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f934723f-b66d-409a-bfc9-9b206b383163+7:15574:x1875544001082496:12345-192.168.202.53@tcp:900:lhsmtool_posix.0 Request processed in 107us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658645.910379:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:3.0:1788658645.915005:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658645.915240:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001082752 00000100:00100000:2.0:1788658645.915252:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001082752 00000100:00100000:2.0:1788658645.915400:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:2.0:1788658645.915420:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+7:15574:x1875544001082752:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658645.915449:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658645.915472:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c6ffb4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccbee expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.915554:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c6ffbb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.915569:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c6ffbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.915580:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c6ffbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.915657:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ffc2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.915666:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ffc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.915673:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ffc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.915830:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391200/0x48e67cc629c6ffc9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.915839:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391200/0x48e67cc629c6ffc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.915847:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391200/0x48e67cc629c6ffc9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658645.915857:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788658645.915998:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c6ffbb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916008:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c6ffbb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916015:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c6ffbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916021:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658645.916026:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c6ffbb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916043:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c6ffbb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916055:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a1e90e70a00) 00010000:00010000:2.0:1788658645.916058:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658645.916063:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c6ffbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916069:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c6ffbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916083:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ffc2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916089:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ffc2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916094:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ffc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916099:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658645.916102:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ffc2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916107:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ffc2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916114:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a1d83406000) 00010000:00010000:2.0:1788658645.916116:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658645.916119:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ffc2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.916893:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6ffc2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.919034:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c6ffb4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbee expref: 10 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.919059:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391200/0x48e67cc629c6ffc9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbee expref: 9 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658645.919068:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83406a00) 00010000:00010000:2.0:1788658645.919071:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658645.919075:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391200, rc 0) 00000100:00100000:2.0:1788658645.919251:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+9:15574:x1875544001082752:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 3840us (4255us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788658645.919260:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:3.0:1788658645.922911:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658645.928887:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001082880 00000100:00100000:1.0:1788658645.928903:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001082880 00000100:00100000:1.0:1788658645.928966:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1788658645.928976:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+9:15574:x1875544001082880:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788658645.929107:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+9:15574:x1875544001082880:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 131us (6206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658645.929116:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:1.0:1788658645.939494:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658645.942893:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001083008 00000100:00100000:0.0:1788658645.942914:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001083008 00000100:00100000:0.0:1788658645.943018:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:0.0:1788658645.943032:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+5:15574:x1875544001083008:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788658645.943167:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788658645.945476:0:17164:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2399us 00000100:00100000:2.0:1788658645.952452:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025288192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788658645.952527:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658645.952587:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025288192 00000100:00100000:2.0:1788658645.952593:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025288192 00000100:00100000:2.0:1788658645.952643:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658645.952652:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025288192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788658645.952695:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788658645.952754:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025288192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658645.952760:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788658645.952819:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658645.952854:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025288192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658645.953035:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658645.953046:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025288320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658645.953092:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658645.953120:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025288320 00000100:00100000:0.0:1788658645.953124:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025288320 00000100:00100000:0.0:1788658645.953155:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658645.953162:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025288320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658645.953172:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788658645.953202:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025288320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658645.953208:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788658645.953227:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658645.953246:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025288320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658645.953616:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025288576:0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.953653:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658645.953686:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025289088:0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.953738:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658645.953754:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025289600:0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.953789:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658645.953810:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788658645.953816:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025288704:0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.953838:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658645.953855:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025289216:0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.953895:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658645.953912:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025289728:0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.953932:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658645.953963:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025289088 00000100:00100000:1.0:1788658645.953968:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025289088 00000100:00100000:1.0:1788658645.954009:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025288704 00000100:00100000:1.0:1788658645.954013:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025288704 00000100:00100000:1.0:1788658645.954033:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658645.954040:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025289088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954157:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025288576 00000100:00100000:0.0:1788658645.954167:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025288576 00000100:00100000:0.0:1788658645.954202:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788658645.954209:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025288576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954254:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025288576:12345-0@lo:400:kworker.0 Request processed in 45us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658645.954260:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788658645.954282:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658645.954288:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025288704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954315:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025288704:12345-0@lo:400:kworker.0 Request processed in 28us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658645.954321:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788658645.954341:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658645.954351:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025288448:0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954441:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658645.954467:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025288960:0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954490:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658645.954506:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025289472:0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954523:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658645.954534:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788658645.954539:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025288832:0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954556:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658645.954565:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025289344:0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954580:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658645.954598:0:18107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025288960 00000100:00100000:0.0:1788658645.954601:0:18107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025288960 00000100:00100000:0.0:1788658645.954623:0:18107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788658645.954635:0:18107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025288960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954667:0:18107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025288960:12345-0@lo:400:kworker.0 Request processed in 32us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658645.954672:0:18107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788658645.954725:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025288960:0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954761:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025288704:0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954782:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025288576:0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954803:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025289600 00000100:00100000:0.0:1788658645.954806:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025289600 00000100:00100000:0.0:1788658645.954836:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025289216 00000100:00100000:0.0:1788658645.954838:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025289216 00000100:00100000:0.0:1788658645.954851:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025289728 00000100:00100000:0.0:1788658645.954853:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025289728 00000100:00100000:0.0:1788658645.954868:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025289472 00000100:00100000:0.0:1788658645.954870:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025289472 00000100:00100000:0.0:1788658645.954881:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025288832 00000100:00100000:0.0:1788658645.954882:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025288832 00000100:00100000:0.0:1788658645.954891:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025289344 00000100:00100000:0.0:1788658645.954893:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025289344 00000100:00100000:0.0:1788658645.954908:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788658645.954915:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025289600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954951:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875544025289600:12345-0@lo:400:kworker.0 Request processed in 37us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658645.954956:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788658645.954968:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788658645.954973:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025289216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658645.954998:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875544025289216:12345-0@lo:400:kworker.0 Request processed in 25us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658645.955009:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788658645.955023:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788658645.955028:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025289728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658645.955185:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025288448 00000100:00100000:2.0:1788658645.955190:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025288448 00000100:00100000:2.0:1788658645.955225:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788658645.955233:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3650:x1875544025288448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658645.955279:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3650:x1875544025288448:12345-0@lo:400:kworker.0 Request processed in 47us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658645.955285:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788658645.955330:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:913293d7-fe00-4834-a4c1-1b0cae17d59a:3650:1875544025288448:0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.955507:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025289088:12345-0@lo:400:kworker.0 Request processed in 1466us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658645.955516:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788658645.955537:0:17163:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788658645.955546:0:17163:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788658645.955660:0:18693:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788658645.955670:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788658645.955678:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025289472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.955740:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875544025289472:12345-0@lo:400:kworker.0 Request processed in 62us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658645.955746:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788658645.955763:0:18693:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788658645.955784:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788658645.955792:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025288832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.955823:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875544025288832:12345-0@lo:400:kworker.0 Request processed in 33us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658645.955828:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788658645.955840:0:18693:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788658645.955855:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788658645.955862:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025289344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.955896:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025289344:12345-0@lo:400:kworker.0 Request processed in 35us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658645.955901:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788658645.955931:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875544025288832:0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.955941:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025289344:0@lo:400:kworker.0 00010000:00080000:1.0:1788658645.955954:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef6d80 x1875544025289472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658645.955964:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875544025289472:0@lo:400:kworker.0 00000100:00080000:1.0:1788658645.956002:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788658645.956006:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658645.956030:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875544025289216:0@lo:400:kworker.0 00010000:00080000:1.0:1788658645.956045:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb5ef7480 x1875544025289728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658645.956169:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875544025289728:12345-0@lo:400:kworker.0 Request processed in 1140us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658645.956176:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788658645.956354:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875544025289728:0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.956371:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e84432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025289088:0@lo:400:kworker.0 00000100:00100000:1.0:1788658645.956392:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875544025289600:0@lo:400:kworker.0 00000100:00100000:2.0:1788658645.975618:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+5:15574:x1875544001083008:12345-192.168.202.53@tcp:59:lhsmtool_posix.0 Request processed in 32574us (36122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658645.975635:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 26 00000100:00100000:3.0:1788658645.989764:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658645.989819:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001083136 00000100:00100000:3.0:1788658645.989830:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001083136 00000100:00100000:3.0:1788658645.989892:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:3.0:1788658645.989904:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+9:15580:x1875544001083136:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658645.989925:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658645.989950:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6ffd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccbf5 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990035:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ffde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990052:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ffde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990066:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ffde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990082:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c6ffe5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990088:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c6ffe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990094:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c6ffe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990161:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ffde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990168:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ffde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990175:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ffde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990181:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658645.990185:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ffde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990194:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ffde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990207:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35c7400) 00010000:00010000:3.0:1788658645.990210:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658645.990215:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ffde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990222:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c6ffde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990236:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c6ffe5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990242:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c6ffe5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990248:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c6ffe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990259:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:3.0:1788658645.990261:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c6ffe5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990267:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c6ffe5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990275:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1e84421c00) 00010000:00010000:3.0:1788658645.990277:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658645.990280:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c6ffe5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990286:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c6ffe5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990320:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6ffd7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbf5 expref: 10 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990330:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35c7400) 00010000:00010000:3.0:1788658645.990332:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658645.990336:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c6ffd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbf5 expref: 10 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658645.990345:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96c00, rc 0) 00000100:00100000:3.0:1788658645.990403:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+9:15580:x1875544001083136:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 501us (703us total) trans 0 rc 301/301 00000100:00100000:3.0:1788658645.990411:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:1.0:1788658646.008283:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658646.008468:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001083264 00000100:00100000:3.0:1788658646.008492:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001083264 00000100:00100000:3.0:1788658646.008547:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:3.0:1788658646.008558:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f934723f-b66d-409a-bfc9-9b206b383163+9:15580:x1875544001083264:12345-192.168.202.53@tcp:700:lfs.0 00000100:00100000:3.0:1788658646.008646:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f934723f-b66d-409a-bfc9-9b206b383163+9:15580:x1875544001083264:12345-192.168.202.53@tcp:700:lfs.0 Request processed in 89us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658646.008654:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:3.0:1788658646.018596:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658646.018750:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001083520 00000100:00100000:0.0:1788658646.018760:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001083520 00000100:00100000:0.0:1788658646.018838:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:0.0:1788658646.018850:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+9:15580:x1875544001083520:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:0.0:1788658646.018914:0:17163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658646.018941:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1d83419c00/0x48e67cc629c6ff05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccb62 expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.018962:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35c7400) 00010000:00010000:0.0:1788658646.018980:0:17163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658646.019048:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.019243:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd2 expref: 5 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.019255:0:17163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.019291:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd2 expref: 5 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.019327:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd2 expref: 5 pid: 17164 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658646.019341:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1e812a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1875544025289856:192.168.202.53@tcp:104: 00000100:00100000:0.0:1788658646.019419:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83504900 going to sleep for 11 seconds 00000100:00100000:0.0:1788658646.022923:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1e812a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1875544025289856:192.168.202.53@tcp:104: 00010000:00010000:0.0:1788658646.022961:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658646.027642:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658646.027920:0:18316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001083648 00000100:00100000:2.0:1788658646.027931:0:18316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001083648 00010000:00010000:2.0:1788658646.028002:0:18316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd2 expref: 6 pid: 17164 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658646.028047:0:18316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 15 00000100:00100000:2.0:1788658646.028072:0:18316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2397:x1875544001083648:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658646.028088:0:18316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658646.028095:0:18316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd2 expref: 6 pid: 17164 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.028109:0:18316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd2 expref: 6 pid: 17164 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.028150:0:18316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c6ff44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbd2 expref: 6 pid: 17164 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.028167:0:18316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35c7400) 00010000:00010000:2.0:1788658646.028172:0:18316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.028181:0:18316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.028188:0:18316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.028221:0:18316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658646.028281:0:18316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2397:x1875544001083648:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 224us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658646.028289:0:18316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 15 00010000:00010000:0.0:1788658646.028359:0:17163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.028369:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.028398:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.028409:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.028418:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788658646.029695:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788658646.031341:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031521:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031536:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658646.031558:0:17163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034f8ff41 reply state 00000000e66ecee3 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031570:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031587:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:2.0:1788658646.031590:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788658646.031595:0:17163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788658646.031601:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788658646.031611:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031618:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031624:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031630:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658646.031635:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031643:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031653:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1eb35c7400) 00010000:00010000:2.0:1788658646.031656:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658646.031660:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031666:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c6ffec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658646.031687:0:17163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000034f8ff41 reply state 00000000e66ecee3 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031764:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.031771:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1e90e70c00) 00010000:00010000:2.0:1788658646.031774:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788658646.031788:0:17163:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788658646.031890:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+10:15580:x1875544001083520:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 13038us (13301us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788658646.031900:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00010000:00010000:0.0:1788658646.079007:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658646.154057:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658646.154303:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001083776 00000100:00100000:2.0:1788658646.154320:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001083776 00000100:00100000:2.0:1788658646.154457:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:2.0:1788658646.154472:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+10:15588:x1875544001083776:12345-192.168.202.53@tcp:101:lctl.0 00010000:00010000:2.0:1788658646.154508:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658646.154542:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccbfc expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.154641:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c70008 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.154660:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c70008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.154675:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c70008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658646.154768:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788658646.154772:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658646.154851:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c70008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.154892:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbfc expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.154915:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391600/0x48e67cc629c70008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccbfc expref: 11 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.154926:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83406900) 00010000:00010000:2.0:1788658646.154929:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658646.154933:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391600, rc 0) 00000100:00100000:2.0:1788658646.155017:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+11:15588:x1875544001083776:12345-192.168.202.53@tcp:101:lctl.0 Request processed in 548us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658646.155026:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:3.0:1788658646.203353:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658646.203402:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658646.203527:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001084032 00000100:00100000:0.0:1788658646.203541:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001084032 00000100:00100000:0.0:1788658646.203618:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:0.0:1788658646.203650:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+5:2399:x1875544001084032:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658646.203783:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+5:2399:x1875544001084032:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 137us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658646.203791:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:3.0:1788658646.206378:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658646.212505:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658646.212589:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001084288 00000100:00100000:1.0:1788658646.212605:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001084288 00000100:00100000:3.0:1788658646.212734:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658646.212774:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001083904 00000100:00100000:0.0:1788658646.212778:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001083904 00000100:00100000:0.0:1788658646.212856:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 168 00000100:00100000:0.0:1788658646.212868:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2399:x1875544001083904:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658646.217593:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e885e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2399:x1875544001083904:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 4708us (5146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658646.217613:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 168 00000100:00080000:0.0:1788658646.217724:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658646.219206:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658646.219245:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658646.219331:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001084544 00000100:00100000:2.0:1788658646.219345:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001084544 00000100:00100000:2.0:1788658646.219409:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001084160 00000100:00100000:2.0:1788658646.219412:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001084160 00000100:00100000:2.0:1788658646.219443:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1788658646.219457:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+5:2399:x1875544001084288:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658646.219540:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+5:2399:x1875544001084288:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 85us (16136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658646.219548:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:2.0:1788658646.219569:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1788658646.219575:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2399:x1875544001084544:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658646.219603:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2399:x1875544001084544:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 28us (13238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658646.219627:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:2.0:1788658646.219641:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:2.0:1788658646.219647:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e86f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+5:2399:x1875544001084160:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658646.219670:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e86f90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+5:2399:x1875544001084160:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (6936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658646.219676:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:2.0:1788658646.220023:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001084416 00000100:00100000:2.0:1788658646.220028:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001084416 00000100:00100000:2.0:1788658646.220071:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:2.0:1788658646.220079:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2399:x1875544001084416:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658646.220118:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2399:x1875544001084416:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 39us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658646.220125:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00080000:2.0:1788658646.220197:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788658646.220202:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658646.224552:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658646.224640:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001084800 00000100:00100000:0.0:1788658646.224655:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001084800 00000100:00100000:0.0:1788658646.224754:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:0.0:1788658646.224768:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:15589:x1875544001084800:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658646.224806:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658646.224839:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c7000f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc03 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.224940:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602e00/0x48e67cc629c70016 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.224969:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602e00/0x48e67cc629c70016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.224983:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602e00/0x48e67cc629c70016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658646.225066:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788658646.225072:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658646.225223:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602e00/0x48e67cc629c70016 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.225256:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c7000f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc03 expref: 7 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.225279:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602e00/0x48e67cc629c70016 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc03 expref: 6 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.225291:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83406900) 00010000:00010000:0.0:1788658646.225295:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658646.225299:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602e00, rc 0) 00000100:00100000:0.0:1788658646.225379:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:15589:x1875544001084800:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 614us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658646.225388:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:2.0:1788658646.225578:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001084672 00000100:00100000:2.0:1788658646.225585:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001084672 00000100:00100000:2.0:1788658646.225691:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:2.0:1788658646.225700:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2399:x1875544001084672:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658646.225748:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2399:x1875544001084672:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 50us (6502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658646.225755:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00080000:0.0:1788658646.225913:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658646.230946:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658646.231540:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001084928 00000100:00100000:1.0:1788658646.231552:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001084928 00000100:00100000:1.0:1788658646.231635:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:1.0:1788658646.231649:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:15589:x1875544001084928:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1788658646.231678:0:20300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658646.231756:0:20300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c7001d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc0a expref: -99 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.231855:0:20300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c70024 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.231876:0:20300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c70024 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.231892:0:20300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c70024 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.231907:0:20300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3c00/0x48e67cc629c7002b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232028:0:20300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3c00/0x48e67cc629c7002b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232037:0:20300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3c00/0x48e67cc629c7002b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232156:0:20300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2000/0x48e67cc629c70032 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232165:0:20300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2000/0x48e67cc629c70032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232173:0:20300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2000/0x48e67cc629c70032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658646.232302:0:20300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788658646.232308:0:20300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658646.232338:0:20300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2000/0x48e67cc629c70032 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232354:0:20300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c70024 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232362:0:20300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c70024 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232370:0:20300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c70024 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232377:0:20300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e81670e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658646.232382:0:20300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c70024 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232391:0:20300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c70024 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232406:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83406900) 00010000:00010000:1.0:1788658646.232409:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658646.232414:0:20300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c70024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232421:0:20300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670e00/0x48e67cc629c70024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232437:0:20300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3c00/0x48e67cc629c7002b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232569:0:20300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3c00/0x48e67cc629c7002b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232576:0:20300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3c00/0x48e67cc629c7002b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232582:0:20300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b3c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658646.232586:0:20300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3c00/0x48e67cc629c7002b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232593:0:20300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3c00/0x48e67cc629c7002b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232602:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1e90e70c00) 00010000:00010000:1.0:1788658646.232605:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658646.232609:0:20300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3c00/0x48e67cc629c7002b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232616:0:20300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3c00/0x48e67cc629c7002b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232653:0:20300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e81670600/0x48e67cc629c7001d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc0a expref: 8 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232668:0:20300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2000/0x48e67cc629c70032 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc0a expref: 7 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.232676:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:1.0:1788658646.232679:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658646.232688:0:20300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2000, rc 0) 00000100:00100000:1.0:1788658646.233067:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+7:15589:x1875544001084928:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 1417us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658646.233078:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 31 00000100:00100000:1.0:1788658646.236326:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658646.236564:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001085056 00000100:00100000:0.0:1788658646.236579:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001085056 00000100:00100000:0.0:1788658646.236653:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:0.0:1788658646.236667:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:15589:x1875544001085056:12345-192.168.202.53@tcp:900:lfs.0 00000100:00100000:0.0:1788658646.236826:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:15589:x1875544001085056:12345-192.168.202.53@tcp:900:lfs.0 Request processed in 161us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658646.236835:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:3.0:1788658646.241561:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658646.241818:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001085312 00000100:00100000:2.0:1788658646.241832:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001085312 00000100:00100000:0.0:1788658646.242019:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:0.0:1788658646.242036:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+7:15589:x1875544001085312:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:0.0:1788658646.242082:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658646.242114:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc11 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658646.242279:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788658646.243520:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70039 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc11 expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.243545:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83406900) 00010000:00010000:0.0:1788658646.243549:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658646.243556:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc11 expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.243571:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602c00, rc 0) 00000100:00100000:0.0:1788658646.244673:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+8:15589:x1875544001085312:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 2629us (3114us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788658646.244687:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 32 00000100:00100000:2.0:1788658646.254498:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658646.254651:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001085568 00000100:00100000:3.0:1788658646.254665:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001085568 00000100:00100000:3.0:1788658646.254784:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:3.0:1788658646.254809:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+8:15589:x1875544001085568:12345-192.168.202.53@tcp:36:lfs.0 00010000:00010000:3.0:1788658646.254909:0:17162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658646.254969:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2000/0x48e67cc629c70032 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc0a expref: 8 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.255000:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:3.0:1788658646.255027:0:17162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658646.255159:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.255243:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.255260:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658646.255585:0:17162:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000499f34f4 reply state 0000000044375bc8 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.255602:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.255609:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:3.0:1788658646.255612:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788658646.255616:0:17162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788658646.255626:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788658646.255853:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+9:15589:x1875544001085568:12345-192.168.202.53@tcp:36:lfs.0 Request processed in 1056us (1370us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788658646.255863:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 33 00000100:00100000:0.0:1788658646.260437:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658646.260597:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001085696 00000100:00100000:1.0:1788658646.260612:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001085696 00000100:00100000:1.0:1788658646.260697:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:1.0:1788658646.260746:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+9:15589:x1875544001085696:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:1.0:1788658646.260781:0:20300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658646.260822:0:20300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3200/0x48e67cc629c7004e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc18 expref: -99 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.260976:0:20300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.260997:0:20300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.261014:0:20300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658646.261053:0:20300:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788658646.261058:0:20300:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788658646.261088:0:20300:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.261126:0:20300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3200/0x48e67cc629c7004e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc18 expref: 11 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.261170:0:20300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc18 expref: 10 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.261322:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:1.0:1788658646.261327:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658646.261332:0:20300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b3400, rc 0) 00000100:00100000:1.0:1788658646.261484:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+10:15589:x1875544001085696:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 741us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658646.261493:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 34 00000100:00100000:1.0:1788658646.269606:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658646.269773:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001085824 00000100:00100000:3.0:1788658646.269790:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001085824 00000100:00100000:3.0:1788658646.269924:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1788658646.269937:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+10:15589:x1875544001085824:12345-192.168.202.53@tcp:37:lfs.0 00000100:00100000:2.0:1788658646.280313:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+10:15589:x1875544001085824:12345-192.168.202.53@tcp:37:lfs.0 Request processed in 10360us (10707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658646.280341:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000040:00080000:0.0:1788658646.281046:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658646.294288:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658646.294453:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001086080 00000100:00100000:1.0:1788658646.294467:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001086080 00000100:00100000:1.0:1788658646.294596:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:1.0:1788658646.294610:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+10:15589:x1875544001086080:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658646.294950:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+11:15589:x1875544001086080:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 342us (675us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788658646.294959:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 3 00000100:00100000:1.0:1788658646.380197:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658646.380334:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001086208 00000100:00100000:0.0:1788658646.380349:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001086208 00000100:00100000:0.0:1788658646.380446:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:0.0:1788658646.380460:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+11:15595:x1875544001086208:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:0.0:1788658646.380487:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658646.380517:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c7005c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc1f expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.380631:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602800/0x48e67cc629c70063 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.380650:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602800/0x48e67cc629c70063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.380667:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602800/0x48e67cc629c70063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.380680:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c7006a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.380688:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c7006a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.380694:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c7006a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.380870:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c70071 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.380880:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c70071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.380887:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c70071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658646.380947:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788658646.380952:0:17164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788658646.381014:0:17164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c70071 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381046:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602800/0x48e67cc629c70063 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381054:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602800/0x48e67cc629c70063 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381062:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602800/0x48e67cc629c70063 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381070:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658646.381076:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602800/0x48e67cc629c70063 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381085:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602800/0x48e67cc629c70063 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381100:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83406900) 00010000:00010000:0.0:1788658646.381104:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658646.381110:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602800/0x48e67cc629c70063 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381118:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602800/0x48e67cc629c70063 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381132:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c7006a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381139:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c7006a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381145:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c7006a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381158:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658646.381162:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c7006a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381168:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c7006a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381177:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1e90e70c00) 00010000:00010000:0.0:1788658646.381179:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658646.381182:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c7006a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381188:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c7006a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381220:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c7005c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc1f expref: 13 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381235:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603200/0x48e67cc629c70071 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc1f expref: 12 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.381243:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:0.0:1788658646.381246:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788658646.381249:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf603200, rc 0) 00000100:00100000:0.0:1788658646.381341:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+12:15595:x1875544001086208:12345-192.168.202.53@tcp:101:bash.0 Request processed in 884us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658646.381350:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 35 00000100:00100000:0.0:1788658646.389235:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658646.389383:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001086336 00000100:00100000:1.0:1788658646.389398:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001086336 00000100:00100000:1.0:1788658646.389473:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:1.0:1788658646.389487:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f934723f-b66d-409a-bfc9-9b206b383163+5:15595:x1875544001086336:12345-192.168.202.53@tcp:900:bash.0 00000100:00100000:1.0:1788658646.389609:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f934723f-b66d-409a-bfc9-9b206b383163+5:15595:x1875544001086336:12345-192.168.202.53@tcp:900:bash.0 Request processed in 126us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658646.389630:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1788658646.394369:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658646.394482:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001086592 00000100:00100000:3.0:1788658646.394493:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001086592 00000100:00100000:3.0:1788658646.394578:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:3.0:1788658646.394590:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+12:15595:x1875544001086592:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:3.0:1788658646.394630:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658646.394650:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c70078 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc26 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.394848:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.394867:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc18 expref: 10 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.394878:0:17163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.394918:0:17163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc18 expref: 10 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.394933:0:17163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc18 expref: 10 pid: 20300 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658646.394948:0:17163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d83d51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1875544025289984:192.168.202.53@tcp:104: 00000100:00100000:3.0:1788658646.395035:0:17163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1d83485a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788658646.410905:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658646.411177:0:17163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d83d51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17163:1875544025289984:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658646.411206:0:17163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658646.412854:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001086720 00000100:00100000:1.0:1788658646.412879:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001086720 00010000:00010000:1.0:1788658646.412973:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc18 expref: 11 pid: 20300 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658646.413035:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 16 00000100:00100000:1.0:1788658646.413048:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+11:2396:x1875544001086720:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658646.413079:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658646.413088:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc18 expref: 11 pid: 20300 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.413106:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc18 expref: 11 pid: 20300 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.413137:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b3400/0x48e67cc629c70055 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc18 expref: 11 pid: 20300 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.413159:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:1.0:1788658646.413165:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.413179:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.413189:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658646.413256:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658646.413352:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+10:2396:x1875544001086720:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 305us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658646.413361:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 16 00010000:00010000:2.0:1788658646.413930:0:17163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.413950:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.413992:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.414005:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.414016:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.415955:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.415979:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.415992:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658646.416020:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788658646.416057:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.416065:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.416072:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.416078:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658646.416083:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.416091:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.416105:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:2.0:1788658646.416108:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658646.416114:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.416121:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97000/0x48e67cc629c7007f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658646.417643:0:17163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002517b214 reply state 000000005740caa1 transno 8589934598 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.417671:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.418255:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a1d83406500) 00010000:00010000:2.0:1788658646.418259:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788658646.418263:0:17163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788658646.418329:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96c00/0x48e67cc629c70078 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc26 expref: 15 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.418352:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc26 expref: 14 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.418360:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658646.418362:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788658646.418365:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390000, rc 0) 00000100:00100000:2.0:1788658646.420310:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+15:15595:x1875544001086592:12345-192.168.202.53@tcp:101:bash.0 Request processed in 25712us (25941us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788658646.420324:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 36 00000100:00100000:3.0:1788658646.445073:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658646.445190:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001086848 00000100:00100000:2.0:1788658646.445205:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001086848 00000100:00100000:2.0:1788658646.445273:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:2.0:1788658646.445285:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+15:15595:x1875544001086848:12345-192.168.202.53@tcp:101:bash.0 00010000:00010000:2.0:1788658646.445310:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658646.445334:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c7009b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc2d expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.445517:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.445541:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.445569:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658646.445618:0:18693:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788658646.445623:0:18693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658646.445641:0:18693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.445652:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.445678:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c7009b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc2d expref: 17 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.445754:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc2d expref: 16 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.445764:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658646.445768:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658646.446459:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390400, rc 0) 00000100:00100000:2.0:1788658646.446603:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+16:15595:x1875544001086848:12345-192.168.202.53@tcp:101:bash.0 Request processed in 1317us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658646.446613:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 37 00000100:00100000:0.0:1788658646.452535:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658646.452698:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001087104 00000100:00100000:2.0:1788658646.452747:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001087104 00000100:00100000:2.0:1788658646.452840:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 4 00000100:00100000:2.0:1788658646.452851:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83679050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+16:15595:x1875544001087104:12345-192.168.202.53@tcp:35:bash.0 00000001:00080000:2.0:1788658646.453073:0:17165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934599 00000100:00100000:2.0:1788658646.453617:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83679050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+18:15595:x1875544001087104:12345-192.168.202.53@tcp:35:bash.0 Request processed in 765us (1097us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788658646.453626:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 4 00000020:00080000:2.0:1788658646.453633:0:17165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788658646.596361:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658646.596491:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001087360 00000100:00100000:3.0:1788658646.596501:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001087360 00000100:00100000:3.0:1788658646.596636:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:3.0:1788658646.596650:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+18:15605:x1875544001087360:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:3.0:1788658646.596677:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658646.596758:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c700a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc34 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658646.596901:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788658646.597297:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c700a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc34 expref: 20 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.597316:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a1d83406900) 00010000:00010000:3.0:1788658646.597319:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658646.597325:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c700a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc34 expref: 20 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658646.597341:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96600, rc 0) 00000100:00100000:3.0:1788658646.597408:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+19:15605:x1875544001087360:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 760us (1058us total) trans 8589934601 rc 301/301 00000100:00100000:3.0:1788658646.597415:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 38 00000100:00100000:3.0:1788658646.600131:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658646.601682:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001087616 00000100:00100000:2.0:1788658646.601699:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001087616 00000100:00100000:2.0:1788658646.604224:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:2.0:1788658646.604247:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f934723f-b66d-409a-bfc9-9b206b383163+19:15605:x1875544001087616:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:2.0:1788658646.604595:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f934723f-b66d-409a-bfc9-9b206b383163+20:15605:x1875544001087616:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 288us (4404us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788658646.604606:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 5 00000100:00100000:0.0:1788658646.652492:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658646.652660:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001087872 00000100:00100000:2.0:1788658646.652671:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001087872 00000100:00100000:2.0:1788658646.652761:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 39 00000100:00100000:2.0:1788658646.652773:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+20:15608:x1875544001087872:12345-192.168.202.53@tcp:101:lfs.0 00010000:00010000:2.0:1788658646.652799:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658646.652823:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc3b expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.652949:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c700be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.652964:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c700be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.652991:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c700be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658646.653003:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788658646.653120:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc3b expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.653142:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c700be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc3b expref: 22 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.653150:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658646.653153:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788658646.653157:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391400, rc 0) 00000100:00100000:2.0:1788658646.653223:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+22:15608:x1875544001087872:12345-192.168.202.53@tcp:101:lfs.0 Request processed in 453us (742us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788658646.653231:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 39 00000040:00080000:1.0:1788658646.656426:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658646.656955:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658646.657039:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658646.657093:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001088000 00000100:00100000:2.0:1788658646.657102:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001088000 00000100:00100000:1.0:1788658646.657171:0:18316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001088128 00000100:00100000:1.0:1788658646.657176:0:18316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001088128 00000100:00100000:2.0:1788658646.657251:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:2.0:1788658646.657263:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+23:15608:x1875544001088000:12345-192.168.202.53@tcp:54:lfs.0 00000100:00100000:0.0:1788658646.657275:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:0.0:1788658646.657287:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+23:2399:x1875544001088128:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658646.657300:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658646.657325:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c700be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc3b expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.657326:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.657351:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.657364:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658646.658363:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:0.0:1788658646.658381:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658646.658432:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.658443:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658646.658456:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+22:2399:x1875544001088128:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 1170us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658646.658471:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00010000:00010000:2.0:1788658646.658473:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.658482:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658646.658486:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.658495:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.658506:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658646.658510:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788658646.658513:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700cc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658646.658519:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658646.658562:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+21:15608:x1875544001088000:12345-192.168.202.53@tcp:54:lfs.0 Request processed in 1302us (1610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658646.658570:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 40 00000100:00100000:3.0:1788658646.660664:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658646.660881:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001088384 00000100:00100000:1.0:1788658646.660893:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001088384 00000100:00100000:1.0:1788658646.660951:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:1.0:1788658646.660962:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+21:15608:x1875544001088384:12345-192.168.202.53@tcp:35:lfs.0 00000100:00100000:1.0:1788658646.661200:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+22:15608:x1875544001088384:12345-192.168.202.53@tcp:35:lfs.0 Request processed in 240us (545us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788658646.661219:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 6 00000100:00100000:3.0:1788658646.974906:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658646.974932:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025290112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788658646.975018:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658646.975301:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025290112 00000100:00100000:0.0:1788658646.975310:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025290112 00000100:00100000:0.0:1788658646.975364:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658646.975373:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025290112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788658646.975400:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788658646.975457:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7402d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025290112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658646.975464:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658646.975552:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025290112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788658647.010818:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658647.010937:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001088640 00000100:00100000:3.0:1788658647.010948:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001088640 00000100:00100000:3.0:1788658647.011097:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00100000:3.0:1788658647.011110:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+22:15639:x1875544001088640:12345-192.168.202.53@tcp:101:cat.0 00010000:00010000:3.0:1788658647.011134:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658647.011171:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c700d3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc42 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.011285:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c700da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.011300:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c700da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.011314:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c700da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658647.011327:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788658647.011452:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c700d3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc42 expref: 25 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.011472:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c700da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc42 expref: 24 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.011482:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:3.0:1788658647.011485:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658647.011489:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b97c00, rc 0) 00000100:00100000:3.0:1788658647.011563:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+24:15639:x1875544001088640:12345-192.168.202.53@tcp:101:cat.0 Request processed in 456us (755us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788658647.011571:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 41 00000100:00080000:0.0:1788658647.014321:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788658647.029846:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658647.029997:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658647.030747:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001089024 00000100:00100000:1.0:1788658647.030760:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001089024 00000100:00100000:1.0:1788658647.030834:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:1.0:1788658647.030846:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f934723f-b66d-409a-bfc9-9b206b383163+24:2397:x1875544001089024:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658647.030861:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658647.030896:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c700da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc42 expref: 24 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.030918:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:1.0:1788658647.030924:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658647.030988:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f934723f-b66d-409a-bfc9-9b206b383163+23:2397:x1875544001089024:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 144us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658647.031005:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:2.0:1788658647.033022:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001088896 00000100:00100000:2.0:1788658647.033037:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001088896 00000100:00100000:2.0:1788658647.033169:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 7 00000100:00100000:2.0:1788658647.033181:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f934723f-b66d-409a-bfc9-9b206b383163+23:15639:x1875544001088896:12345-192.168.202.53@tcp:35:cat.0 00000100:00100000:2.0:1788658647.033481:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f934723f-b66d-409a-bfc9-9b206b383163+24:15639:x1875544001088896:12345-192.168.202.53@tcp:35:cat.0 Request processed in 302us (3644us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788658647.033490:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 7 00010000:00010000:1.0:1788658647.103093:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658647.107106:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.107216:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001089280 00000100:00100000:2.0:1788658647.107225:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001089280 00000100:00100000:2.0:1788658647.107276:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:2.0:1788658647.107285:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+24:15645:x1875544001089280:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:2.0:1788658647.107310:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658647.107331:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc49 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.107428:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.107443:0:17164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc26 expref: 25 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.107451:0:17164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc2d expref: 25 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.107459:0:17164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.107489:0:17164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc2d expref: 25 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.107502:0:17164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc2d expref: 25 pid: 18693 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.107515:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2252680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875544025290240:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658647.107602:0:17164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc26 expref: 25 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.107625:0:17164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc26 expref: 25 pid: 17163 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.107635:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875544025290368:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658647.107655:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc611000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658647.114423:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658647.114460:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.114584:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2252680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875544025290240:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658647.114596:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875544025290368:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658647.114625:0:17164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658647.114941:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001089408 00000100:00100000:3.0:1788658647.114948:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001089408 00010000:00010000:3.0:1788658647.114984:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc2d expref: 26 pid: 18693 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658647.115039:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001089536 00000100:00100000:3.0:1788658647.115042:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001089536 00010000:00010000:3.0:1788658647.115054:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc26 expref: 27 pid: 17163 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658647.115082:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1788658647.115091:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+27:2396:x1875544001089408:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658647.115104:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658647.115111:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc2d expref: 27 pid: 18693 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115122:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc2d expref: 27 pid: 18693 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115143:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c700a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc2d expref: 27 pid: 18693 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115234:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:3.0:1788658647.115240:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115248:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115255:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658647.115311:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+26:2396:x1875544001089408:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 221us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658647.115326:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 17 00000100:00100000:3.0:1788658647.115345:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 18 00000100:00100000:3.0:1788658647.115352:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eabc40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+25:2396:x1875544001089536:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658647.115359:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658647.115364:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc26 expref: 25 pid: 17163 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115373:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc26 expref: 25 pid: 17163 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115384:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c7008d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc26 expref: 25 pid: 17163 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115393:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:3.0:1788658647.115396:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115403:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115411:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.115430:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658647.115449:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eabc40050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+24:2396:x1875544001089536:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 97us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658647.115454:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 18 00010000:00010000:2.0:1788658647.116247:0:17164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.116257:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658647.116277:0:17164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788658647.116433:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c700e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc49 expref: 25 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.116450:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391800/0x48e67cc629c700ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc49 expref: 24 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.116458:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658647.116460:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788658647.116463:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391800, rc 0) 00000100:00100000:2.0:1788658647.116504:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+24:15645:x1875544001089280:12345-192.168.202.53@tcp:101:dd.0 Request processed in 9219us (9407us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788658647.116511:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 42 00000100:00100000:0.0:1788658647.122783:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.122905:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001089664 00000100:00100000:2.0:1788658647.122916:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001089664 00000100:00100000:2.0:1788658647.122980:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:2.0:1788658647.122990:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+24:15645:x1875544001089664:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:2.0:1788658647.123014:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658647.123036:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c700fd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc50 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.123072:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.123085:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.123096:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.123218:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c700fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc50 expref: 26 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.123237:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc50 expref: 25 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.123246:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658647.123249:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788658647.123252:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391400, rc 0) 00000100:00100000:2.0:1788658647.123318:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+25:15645:x1875544001089664:12345-192.168.202.53@tcp:101:dd.0 Request processed in 329us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.123326:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 43 00000100:00100000:3.0:1788658647.130613:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.131875:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001089920 00000100:00100000:2.0:1788658647.131900:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001089920 00000100:00100000:2.0:1788658647.131971:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 44 00000100:00100000:2.0:1788658647.131982:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+25:15645:x1875544001089920:12345-192.168.202.53@tcp:36:dd.0 00010000:00010000:2.0:1788658647.132222:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.132241:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.132253:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658647.132296:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934608 00000004:00010000:2.0:1788658647.132318:0:17163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009475ce5 reply state 00000000f5263070 transno 8589934609 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.132331:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.132339:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658647.132342:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788658647.132346:0:17163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658647.132495:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+28:15645:x1875544001089920:12345-192.168.202.53@tcp:36:dd.0 Request processed in 513us (1893us total) trans 8589934609 rc 0/0 00000100:00100000:2.0:1788658647.132502:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 44 00000020:00080000:2.0:1788658647.132508:0:17163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788658647.138546:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.138632:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001090048 00000100:00100000:2.0:1788658647.138642:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001090048 00000100:00100000:2.0:1788658647.138810:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:2.0:1788658647.138824:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+28:15645:x1875544001090048:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:2.0:1788658647.138848:0:17164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658647.138869:0:17164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c70112 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc57 expref: -99 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.138939:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c70112 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc57 expref: 29 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.138954:0:17164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c70112 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc57 expref: 29 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.138974:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658647.138977:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658647.138981:0:17164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390a00, rc 0) 00000100:00100000:2.0:1788658647.139042:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+29:15645:x1875544001090048:12345-192.168.202.53@tcp:101:dd.0 Request processed in 222us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.139049:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 45 00000100:00100000:0.0:1788658647.171927:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658647.172022:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001090304 00000100:00100000:3.0:1788658647.172033:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001090304 00000100:00100000:3.0:1788658647.172103:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1788658647.172114:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+29:15645:x1875544001090304:12345-192.168.202.53@tcp:103:dd.0 00010000:00010000:3.0:1788658647.172129:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658647.172154:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c70112 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc57 expref: 29 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.172186:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:3.0:1788658647.172192:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658647.172261:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+28:15645:x1875544001090304:12345-192.168.202.53@tcp:103:dd.0 Request processed in 148us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658647.172268:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 2 00000100:00100000:3.0:1788658647.182441:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658647.183114:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001090432 00000100:00100000:0.0:1788658647.183128:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001090432 00000100:00100000:0.0:1788658647.183203:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:0.0:1788658647.183215:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb7400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+28:15645:x1875544001090432:12345-192.168.202.53@tcp:58:dd.0 00010000:00010000:0.0:1788658647.183333:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.183350:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.183361:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658647.187103:0:17162:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658647.187420:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788658647.187587:0:17162:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788658647.187759:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb7400e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+28:15645:x1875544001090432:12345-192.168.202.53@tcp:58:dd.0 Request processed in 4487us (5270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658647.187770:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 46 00000100:00100000:1.0:1788658647.189745:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.189852:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001090560 00000100:00100000:2.0:1788658647.189862:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001090560 00000100:00100000:2.0:1788658647.189934:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 47 00000100:00100000:2.0:1788658647.189945:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+29:15645:x1875544001090560:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:2.0:1788658647.189967:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658647.189990:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70120 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc5e expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.190067:0:17163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.190079:0:17163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70120 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc5e expref: 30 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.190099:0:17163:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.190112:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70120 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc5e expref: 30 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.190126:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658647.190129:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658647.190133:0:17163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70120 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc5e expref: 30 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.190142:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3391e00, rc 0) 00000100:00100000:2.0:1788658647.190205:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+30:15645:x1875544001090560:12345-192.168.202.53@tcp:101:dd.0 Request processed in 262us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.190213:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 47 00000040:00080000:0.0:1788658647.680956:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788658647.680977:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658647.681005:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788658647.681017:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788658647.681170:0:17196:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1d837ce680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17196:1875544025290496:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788658647.681293:0:17196:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1193180 going to sleep for 11 seconds 00000100:00100000:0.0:1788658647.686513:0:17196:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1d837ce680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17196:1875544025290496:192.168.202.53@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788658647.701091:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.701399:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001090688 00000100:00100000:2.0:1788658647.701409:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001090688 00000100:00100000:2.0:1788658647.701483:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:2.0:1788658647.701494:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+29:15646:x1875544001090688:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788658647.701529:0:17164:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788658647.701670:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+29:15646:x1875544001090688:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 178us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.701677:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 48 00000100:00100000:1.0:1788658647.711929:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.712059:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001090816 00000100:00100000:2.0:1788658647.712070:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001090816 00000100:00100000:2.0:1788658647.712134:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:2.0:1788658647.712145:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+29:15646:x1875544001090816:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788658647.712230:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70127 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712247:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70127 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712260:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70127 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712317:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c7012e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712339:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c7012e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712346:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c7012e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712369:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712378:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712385:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658647.712461:0:17163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788658647.712466:0:17163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658647.712479:0:17163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712490:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70127 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712496:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70127 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712503:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70127 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712509:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658647.712513:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70127 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712521:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70127 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712532:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83406a00) 00010000:00010000:2.0:1788658647.712535:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658647.712540:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70127 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712547:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70127 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712561:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c7012e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712577:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c7012e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712582:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c7012e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712586:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658647.712589:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c7012e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712596:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c7012e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712603:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8a1d83406b00) 00010000:00010000:2.0:1788658647.712606:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658647.712609:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c7012e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712614:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c7012e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712630:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712636:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712641:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712645:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:2.0:1788658647.712654:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712660:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712669:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658647.712671:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658647.712673:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.712679:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c70135 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.713024:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+29:15646:x1875544001090816:12345-192.168.202.53@tcp:34:lhsmtool_posix.0 Request processed in 879us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.713033:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 49 00000100:00100000:1.0:1788658647.718063:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658647.719675:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001091072 00000100:00100000:0.0:1788658647.719689:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001091072 00000100:00100000:0.0:1788658647.719960:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:0.0:1788658647.719973:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+29:15646:x1875544001091072:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658647.719994:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658647.720016:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602600/0x48e67cc629c7013c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc65 expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720130:0:17162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70143 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720147:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70143 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720158:0:17162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70143 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658647.720169:0:17162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788658647.720255:0:17162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70143 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720263:0:17162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70143 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720270:0:17162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70143 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720276:0:17162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf602c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658647.720295:0:17162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70143 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720303:0:17162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70143 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720314:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:0.0:1788658647.720316:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788658647.720320:0:17162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70143 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720327:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70143 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720367:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602600/0x48e67cc629c7013c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc65 expref: 31 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720377:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a1d83406a00) 00010000:00010000:0.0:1788658647.720379:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658647.720383:0:17162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602600/0x48e67cc629c7013c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc65 expref: 31 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.720392:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602600, rc 0) 00000100:00100000:0.0:1788658647.720472:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+30:15646:x1875544001091072:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 502us (2419us total) trans 8589934610 rc 301/301 00000100:00100000:0.0:1788658647.720480:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 50 00000100:00100000:3.0:1788658647.723610:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.727986:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001091200 00000100:00100000:2.0:1788658647.728005:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001091200 00000100:00100000:2.0:1788658647.728195:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:2.0:1788658647.728207:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+30:15646:x1875544001091200:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788658647.728243:0:17164:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788658647.728377:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+30:15646:x1875544001091200:12345-192.168.202.53@tcp:53:lhsmtool_posix.0 Request processed in 172us (4777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.728385:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 51 00000100:00100000:1.0:1788658647.738037:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658647.738580:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001091456 00000100:00100000:3.0:1788658647.738591:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001091456 00000100:00100000:3.0:1788658647.738658:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:3.0:1788658647.738668:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+30:15646:x1875544001091456:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658647.738689:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658647.739411:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70151 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc6c expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658647.739899:0:18693:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:3.0:1788658647.739906:0:18693:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788658647.739926:0:18693:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788658647.740113:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c70158 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.740129:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c70158 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.740141:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c70158 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.740198:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70151 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc6c expref: 33 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.740219:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c70158 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc6c expref: 32 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.740227:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e84421c00) 00010000:00010000:3.0:1788658647.740230:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658647.740233:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1e82b96600, rc 0) 00000100:00100000:3.0:1788658647.740313:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+32:15646:x1875544001091456:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 1646us (2286us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788658647.740321:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 52 00000100:00100000:2.0:1788658647.745844:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658647.747574:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001091712 00000100:00100000:0.0:1788658647.747588:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001091712 00000100:00100000:1.0:1788658647.756791:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:1.0:1788658647.756807:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+32:15646:x1875544001091712:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788658647.756869:0:17163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658647.756897:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96600/0x48e67cc629c70158 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc6c expref: 32 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.756920:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e84421c00) 00010000:00010000:1.0:1788658647.756932:0:17163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658647.756972:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2e00/0x48e67cc629c70166 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.756989:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2e00/0x48e67cc629c70166 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.756999:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2e00/0x48e67cc629c70166 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757014:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c7016d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x928e856d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757021:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c7016d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x928e856d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757045:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c7016d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x928e856d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757097:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2e00/0x48e67cc629c70166 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757105:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2e00/0x48e67cc629c70166 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757112:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2e00/0x48e67cc629c70166 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757118:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2e00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658647.757122:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2e00/0x48e67cc629c70166 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757129:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2e00/0x48e67cc629c70166 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757138:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:1.0:1788658647.757141:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658647.757145:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2e00/0x48e67cc629c70166 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757151:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2e00/0x48e67cc629c70166 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757161:0:17163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c7016d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x928e856d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757167:0:17163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c7016d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x928e856d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757181:0:17163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c7016d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x928e856d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757186:0:17163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb23b2600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658647.757190:0:17163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c7016d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x928e856d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757196:0:17163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c7016d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x928e856d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757204:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x928e856d (ffff8a1e83b21b00) 00010000:00010000:1.0:1788658647.757206:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658647.757209:0:17163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c7016d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x928e856d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.757214:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2600/0x48e67cc629c7016d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x928e856d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658647.757317:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+31:15646:x1875544001091712:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 512us (11483us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658647.757338:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 53 00000100:00100000:0.0:1788658647.762051:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658647.762364:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001091840 00000100:00100000:1.0:1788658647.762374:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001091840 00000100:00100000:1.0:1788658647.762437:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:1.0:1788658647.762448:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+31:15646:x1875544001091840:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658647.762470:0:20300:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658647.762493:0:20300:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2c00/0x48e67cc629c70174 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc73 expref: -99 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.762550:0:20300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2800/0x48e67cc629c7017b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.762564:0:20300:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2800/0x48e67cc629c7017b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.762576:0:20300:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2800/0x48e67cc629c7017b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20300 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.762690:0:20300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2c00/0x48e67cc629c70174 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc73 expref: 33 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.762756:0:20300:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb23b2800/0x48e67cc629c7017b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc73 expref: 32 pid: 20300 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.762766:0:20300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:1.0:1788658647.762769:0:20300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788658647.762780:0:20300:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2800, rc 0) 00000100:00100000:1.0:1788658647.762838:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+32:15646:x1875544001091840:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 391us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658647.762845:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 54 00000100:00100000:2.0:1788658647.771256:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658647.771353:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001092096 00000100:00100000:3.0:1788658647.771365:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001092096 00000100:00100000:3.0:1788658647.771482:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:3.0:1788658647.771493:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+32:15646:x1875544001092096:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658647.771576:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.771594:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.771624:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658647.771920:0:18693:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788658647.771931:0:18693:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 564988227428ns, next at 565988224173ns, rc = 0 00000004:00010000:2.0:1788658647.772006:0:18693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015e7c0bd reply state 00000000ee8b3457 transno 8589934612 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.772020:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.772029:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:2.0:1788658647.772032:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788658647.772037:0:18693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658647.772151:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+34:15646:x1875544001092096:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 659us (903us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788658647.772160:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 55 00000100:00100000:2.0:1788658647.784834:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658647.785003:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001092224 00000100:00100000:0.0:1788658647.785028:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001092224 00000100:00100000:0.0:1788658647.785094:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1788658647.785105:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+34:15646:x1875544001092224:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658647.785129:0:17162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658647.785151:0:17162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70189 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc7a expref: -99 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.785218:0:17162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70189 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc7a expref: 35 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.785237:0:17162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70189 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc7a expref: 35 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.785266:0:17162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:0.0:1788658647.785270:0:17162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788658647.785274:0:17162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1ebf602c00, rc 0) 00000100:00100000:0.0:1788658647.785342:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f934723f-b66d-409a-bfc9-9b206b383163+35:15646:x1875544001092224:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 239us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658647.785349:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 56 00000100:00100000:0.0:1788658647.789199:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658647.789358:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001092352 00000100:00100000:1.0:1788658647.789369:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001092352 00000100:00100000:1.0:1788658647.789437:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1788658647.789447:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d837cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f934723f-b66d-409a-bfc9-9b206b383163+5:2397:x1875544001092352:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788658647.789696:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d837cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f934723f-b66d-409a-bfc9-9b206b383163+6:2397:x1875544001092352:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 249us (505us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788658647.789755:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:1.0:1788658647.792747:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.796481:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001092608 00000100:00100000:2.0:1788658647.796497:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001092608 00000100:00100000:2.0:1788658647.796644:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:2.0:1788658647.796656:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+35:15646:x1875544001092608:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788658647.796930:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+36:15646:x1875544001092608:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 276us (4190us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788658647.796947:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 8 00000100:00100000:3.0:1788658647.805181:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658647.805357:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001092864 00000100:00100000:1.0:1788658647.805367:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001092864 00000100:00100000:1.0:1788658647.805438:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:1.0:1788658647.805450:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+36:15646:x1875544001092864:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788658647.805573:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+36:15646:x1875544001092864:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 125us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658647.805581:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 57 00000100:00100000:0.0:1788658647.811820:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.811983:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001092992 00000100:00100000:2.0:1788658647.811994:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001092992 00000100:00100000:2.0:1788658647.812058:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:2.0:1788658647.812069:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+36:15646:x1875544001092992:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658647.812092:0:18693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658647.812114:0:18693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c70190 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc81 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.812215:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70197 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.812578:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70197 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.812592:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70197 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658647.812643:0:18693:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788658647.812662:0:18693:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70197 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.812691:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390400/0x48e67cc629c70190 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc81 expref: 38 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.812735:0:18693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70197 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc81 expref: 37 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.812745:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:2.0:1788658647.812747:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788658647.812751:0:18693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390c00, rc 0) 00000100:00100000:2.0:1788658647.812833:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+37:15646:x1875544001092992:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 765us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.812841:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 58 00000100:00100000:3.0:1788658647.817676:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.818406:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001093120 00000100:00100000:2.0:1788658647.818419:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001093120 00000100:00100000:2.0:1788658647.818485:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:2.0:1788658647.818513:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+6:2398:x1875544001093120:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658647.818530:0:19325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658647.818549:0:19325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c7019e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc88 expref: -99 pid: 19325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658647.818576:0:19325:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc3d7, blocks: 0x0 00010000:00010000:2.0:1788658647.818596:0:19325:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1788658647.818600:0:19325:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658647.818610:0:19325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c7019e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc88 expref: 7 pid: 19325 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.818630:0:19325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c7019e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc88 expref: 7 pid: 19325 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.818644:0:19325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390a00, rc 0) 00000100:00100000:2.0:1788658647.818735:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e812a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+7:2398:x1875544001093120:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 225us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.818742:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:3.0:1788658647.827063:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.830007:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001093376 00000100:00100000:2.0:1788658647.830022:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001093376 00000100:00100000:2.0:1788658647.830175:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:2.0:1788658647.830187:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+37:15646:x1875544001093376:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788658647.830349:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+37:15646:x1875544001093376:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 163us (3298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.830358:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 59 00000100:00100000:0.0:1788658647.835860:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658647.840926:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001093504 00000100:00100000:1.0:1788658647.840952:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001093504 00000100:00100000:0.0:1788658647.841116:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 60 00000100:00100000:0.0:1788658647.841127:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+37:15646:x1875544001093504:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788658647.844264:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1788658647.844282:0:17142:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788658647.844344:0:17142:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000100:00100000:2.0:1788658647.844407:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788658647.844417:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.844424:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025290624:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788658647.844434:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.844444:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.844450:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b96200 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658647.844456:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.844465:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.844481:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:0.0:1788658647.844485:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788658647.844491:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.844497:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658647.844504:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b96200/0x48e67cc629c70047 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658647.844628:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+19:15646:x1875544001093504:12345-192.168.202.53@tcp:44:lhsmtool_posix.0 Request processed in 3500us (8789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658647.844638:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 60 00010000:00010000:1.0:1788658647.844996:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845004:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845011:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845017:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658647.845020:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845026:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845037:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a1e90e70c00) 00010000:00010000:1.0:1788658647.845047:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658647.845051:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845057:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c6fff3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845075:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845081:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845087:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845093:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390600 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658647.845096:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845102:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845112:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a1d83406000) 00010000:00010000:1.0:1788658647.845116:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658647.845118:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845124:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390600/0x48e67cc629c6fffa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845139:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845156:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845162:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845167:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391000 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658647.845170:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845176:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845184:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a1d83406500) 00010000:00010000:1.0:1788658647.845186:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658647.845189:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845195:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391000/0x48e67cc629c70086 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845212:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845218:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845231:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845236:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658647.845245:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845783:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845797:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:1.0:1788658647.845800:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658647.845804:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845810:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391a00/0x48e67cc629c7010b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845824:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845830:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845836:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845841:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1e82b97c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658647.845905:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845912:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845921:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:1.0:1788658647.845923:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788658647.845934:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.845940:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1e82b97c00/0x48e67cc629c70182 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658647.845979:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025290624 00000100:00100000:1.0:1788658647.845986:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025290624 00000100:00080000:2.0:1788658647.846039:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658647.846044:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658647.846054:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025290624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788658647.846178:0:18669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788658647.846182:0:18669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788658647.846184:0:18669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788658647.846186:0:18669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788658647 -> 1788658647 00002000:00010000:1.0:1788658647.846188:0:18669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788658647.846251:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875544025290624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 198us (1756us total) trans 8589934596 rc 0/0 00000004:00080000:2.0:1788658647.846294:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a1eb2250380/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788658647.846302:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025290624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788658647.846935:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658647.852568:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.856175:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001093632 00000100:00100000:2.0:1788658647.856191:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001093632 00000100:00100000:3.0:1788658647.859667:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:3.0:1788658647.859684:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+7:2397:x1875544001093632:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788658647.860576:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+7:2397:x1875544001093632:12345-192.168.202.53@tcp:16:lhsmtool_posix.0 Request processed in 891us (8015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658647.860586:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 27 00000100:00100000:0.0:1788658647.877099:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.877378:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001093888 00000100:00100000:2.0:1788658647.877389:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001093888 00000100:00100000:2.0:1788658647.877458:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:2.0:1788658647.877470:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+15:15646:x1875544001093888:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658647.877526:0:18693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658647.877554:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c70197 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc81 expref: 15 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.877574:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:2.0:1788658647.877579:0:18693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658647.877610:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.877625:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.877635:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658647.877810:0:18693:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a6f12c0 reply state 00000000547c129f transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.877842:0:18693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390000/0x48e67cc629c701a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18693 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.877849:0:18693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:2.0:1788658647.877852:0:18693:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788658647.877855:0:18693:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658647.877966:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f934723f-b66d-409a-bfc9-9b206b383163+16:15646:x1875544001093888:12345-192.168.202.53@tcp:36:lhsmtool_posix.0 Request processed in 498us (877us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788658647.877974:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 61 00000100:00100000:0.0:1788658647.883809:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658647.883900:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001094016 00000100:00100000:1.0:1788658647.883911:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001094016 00000100:00100000:1.0:1788658647.883980:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:1.0:1788658647.883991:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f934723f-b66d-409a-bfc9-9b206b383163+7:15646:x1875544001094016:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658647.884011:0:18669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658647.884031:0:18669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc8f expref: -99 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.884063:0:18669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c7019e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc88 expref: 8 pid: 19325 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.884094:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658647.884099:0:18669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658647.884106:0:18669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 8 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.884143:0:18669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c7019e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc88 expref: 8 pid: 19325 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.884158:0:18669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c7019e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc88 expref: 8 pid: 19325 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658647.884175:0:18669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18669:1875544025290752:192.168.202.53@tcp:104: 00000100:00100000:1.0:1788658647.884314:0:18669:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658647.893299:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658647.893438:0:18316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001094144 00000100:00100000:1.0:1788658647.893449:0:18316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001094144 00010000:00010000:1.0:1788658647.893490:0:18316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c7019e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc88 expref: 9 pid: 19325 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658647.893544:0:18316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 19 00000100:00100000:1.0:1788658647.893555:0:18316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f934723f-b66d-409a-bfc9-9b206b383163+9:2397:x1875544001094144:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658647.893569:0:18316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658647.893592:0:18316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c7019e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc88 expref: 9 pid: 19325 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.893626:0:18316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c7019e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc88 expref: 9 pid: 19325 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.893650:0:18316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658647.893655:0:18316:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658647.893662:0:18316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 9 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.893673:0:18316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 9 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.893753:0:18316:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 9 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658647.893769:0:18316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb5ef7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:18316:1875544025290880:192.168.202.53@tcp:105: 00000100:00100000:1.0:1788658647.893844:0:18316:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205840 going to sleep for 11 seconds 00000100:00100000:3.0:1788658647.896269:0:18316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:18316:1875544025290880:192.168.202.53@tcp:105: 00010000:00010000:3.0:1788658647.896298:0:18316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658647.896359:0:18316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f934723f-b66d-409a-bfc9-9b206b383163+9:2397:x1875544001094144:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 2805us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658647.896370:0:18316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 19 00010000:00010000:2.0:1788658647.900615:0:18669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c7019e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc88 expref: 8 pid: 19325 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.900643:0:18669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb5ef6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:18669:1875544025290752:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658647.900679:0:18669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 7 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.900696:0:18669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb23b2e00, rc 0) 00000100:00100000:2.0:1788658647.900926:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f934723f-b66d-409a-bfc9-9b206b383163+7:15646:x1875544001094016:12345-192.168.202.53@tcp:101:lhsmtool_posix.0 Request processed in 16936us (17128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.900936:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 28 00000100:00100000:1.0:1788658647.908474:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658647.912390:0:19325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001094272 00000100:00100000:3.0:1788658647.912409:0:19325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001094272 00000100:00100000:3.0:1788658647.912533:0:19325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:3.0:1788658647.912545:0:19325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+7:2396:x1875544001094272:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788658647.912726:0:19325:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788658647.912730:0:19325:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788658646 00002000:00010000:3.0:1788658647.912732:0:19325:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788658645 00002000:00010000:3.0:1788658647.912735:0:19325:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788658647 -> 1788658646 00002000:00010000:3.0:1788658647.912737:0:19325:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788658647.912830:0:19325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f934723f-b66d-409a-bfc9-9b206b383163+8:2396:x1875544001094272:12345-192.168.202.53@tcp:2:lhsmtool_posix.0 Request processed in 287us (4365us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788658647.912838:0:19325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 29 00000100:00100000:1.0:1788658647.922496:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.922573:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001094400 00000100:00100000:2.0:1788658647.922583:0:18667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001094400 00000100:00100000:2.0:1788658647.922644:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:2.0:1788658647.922655:0:18667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f934723f-b66d-409a-bfc9-9b206b383163+8:2396:x1875544001094400:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788658647.922723:0:18667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.922760:0:18667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 8 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.922769:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658647.922774:0:18667:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658647.922780:0:18667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.922816:0:18667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 8 pid: 18669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.922831:0:18667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 8 pid: 18669 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.922846:0:18667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18667:1875544025291008:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658647.922939:0:18667:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc611540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658647.927755:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.927874:0:18667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18667:1875544025291008:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658647.927914:0:18667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658647.928065:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001094528 00000100:00100000:1.0:1788658647.928073:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001094528 00010000:00010000:1.0:1788658647.928109:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 9 pid: 18669 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658647.928146:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 20 00000100:00100000:1.0:1788658647.928162:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1e84430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+9:2397:x1875544001094528:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788658647.928177:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658647.928198:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 9 pid: 18669 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.928212:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 9 pid: 18669 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.928235:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d989945/0x48e67cc629c701ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc8f expref: 9 pid: 18669 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.928253:0:17149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658647.928258:0:17149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788658647.928273:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.928284:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.928315:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788658647.928376:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1e84430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+8:2397:x1875544001094528:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 214us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658647.928383:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 20 00010000:00010000:2.0:1788658647.928505:0:18667:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.928514:0:18667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.928543:0:18667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.928551:0:18667:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.928559:0:18667:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.928566:0:18667:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390c00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:2.0:1788658647.928571:0:18667:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.928581:0:18667:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.928593:0:18667:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.928601:0:18667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8877d16/0x48e67cc629c701b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.928651:0:18667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f934723f-b66d-409a-bfc9-9b206b383163+7:2396:x1875544001094400:12345-192.168.202.53@tcp:1:lhsmtool_posix.0 Request processed in 5998us (6165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.928668:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 30 00000100:00100000:3.0:1788658647.931302:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.931358:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001094784 00000100:00100000:2.0:1788658647.931369:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001094784 00000100:00100000:2.0:1788658647.931433:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 62 00000100:00100000:2.0:1788658647.931443:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+16:15646:x1875544001094784:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788658647.931523:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.931540:0:17164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc50 expref: 16 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.931550:0:17164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.931586:0:17164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc50 expref: 16 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.931598:0:17164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc50 expref: 16 pid: 18693 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.931611:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875544025291136:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658647.931693:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc611b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658647.948689:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:0.0:1788658647.948771:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001094912 00000100:00100000:0.0:1788658647.948780:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001094912 00010000:00010000:0.0:1788658647.948820:0:17148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc50 expref: 17 pid: 18693 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658647.948859:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 21 00000100:00100000:0.0:1788658647.948869:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f934723f-b66d-409a-bfc9-9b206b383163+17:2397:x1875544001094912:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658647.948884:0:17148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658647.948891:0:17148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc50 expref: 17 pid: 18693 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.948917:0:17148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc50 expref: 17 pid: 18693 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.948937:0:17148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:0.0:1788658647.948942:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70120 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc5e expref: 17 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.948959:0:17148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.948967:0:17148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.948973:0:17148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.948991:0:17148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658647.949044:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f934723f-b66d-409a-bfc9-9b206b383163+17:2397:x1875544001094912:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 176us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658647.949065:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 21 00010000:00010000:2.0:1788658647.949605:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c70104 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc50 expref: 16 pid: 18693 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.949623:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875544025291136:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658647.949654:0:17164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.949664:0:17164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.949669:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.950032:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.950045:0:17164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70189 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc7a expref: 16 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.950053:0:17164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.950083:0:17164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70189 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc7a expref: 16 pid: 17162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.950097:0:17164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70189 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc7a expref: 16 pid: 17162 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658647.950111:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875544025291264:192.168.202.53@tcp:104: 00000100:00100000:2.0:1788658647.950180:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ebc611540 going to sleep for 11 seconds 00000100:00100000:2.0:1788658647.951755:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875544025291264:192.168.202.53@tcp:104: 00010000:00010000:2.0:1788658647.951784:0:17164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658647.953368:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658647.953511:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001095040 00000100:00100000:3.0:1788658647.953521:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001095040 00010000:00010000:3.0:1788658647.953559:0:17149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70189 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc7a expref: 17 pid: 17162 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658647.953602:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1788658647.953612:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+17:2397:x1875544001095040:12345-192.168.202.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658647.953627:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658647.953634:0:17149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70189 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc7a expref: 17 pid: 17162 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.953648:0:17149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70189 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc7a expref: 17 pid: 17162 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.953671:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf602c00/0x48e67cc629c70189 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc7a expref: 17 pid: 17162 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.953687:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:3.0:1788658647.953693:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.953735:0:17149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.953761:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658647.953798:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658647.953823:0:17164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.953831:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658647.953853:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f934723f-b66d-409a-bfc9-9b206b383163+16:2397:x1875544001095040:12345-192.168.202.53@tcp:103:ldlm_bl.0 Request processed in 242us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658647.953860:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000001:00080000:0.0:1788658647.953971:0:17164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934615 00000001:00080000:0.0:1788658647.954093:0:17164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788658647.954129:0:17164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000100:00100000:0.0:1788658647.954213:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17164:1875544025291392:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788658647.954381:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658647.954416:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1ec1193c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658647.954442:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025291392 00000100:00100000:2.0:1788658647.954446:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025291392 00000100:00100000:2.0:1788658647.954486:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788658647.954494:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17164:x1875544025291392:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788658647.954584:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17164:x1875544025291392:12345-0@lo:1000:mdt00_002.0 Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658647.954591:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788658647.954668:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c94700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17164:1875544025291392:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788658647.954844:0:17164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788658647.954904:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17164:1875544025291520:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788658647.954934:0:17164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658647.954961:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205540 going to sleep for 11 seconds 00000100:00100000:0.0:1788658647.955196:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025291520 00000100:00100000:0.0:1788658647.955200:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025291520 00000100:00100000:0.0:1788658647.955243:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788658647.955251:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17164:x1875544025291520:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788658647.955436:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17164:x1875544025291520:12345-0@lo:1000:mdt00_002.0 Request processed in 185us (500us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788658647.955442:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788658647.955565:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17164:1875544025291520:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788658647.955596:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955604:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955611:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955617:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390c00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658647.955621:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955630:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955641:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:1.0:1788658647.955644:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788658647.955648:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955655:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701c1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955683:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955690:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955736:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955742:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603400 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:1.0:1788658647.955746:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955753:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955763:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:1.0:1788658647.955765:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788658647.955771:0:17164:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70120 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc5e expref: 19 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955780:0:17164:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70120 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc5e expref: 19 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955788:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70120 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc5e expref: 19 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658647.955834:0:17164:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391e00/0x48e67cc629c70120 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc5e expref: 19 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658647.955845:0:17164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875544025291648:192.168.202.53@tcp:105: 00000100:00100000:1.0:1788658647.956570:0:17164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a1e90205a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658647.976973:0:17164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17164:1875544025291648:192.168.202.53@tcp:105: 00010000:00010000:0.0:1788658647.977013:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977024:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603400/0x48e67cc629c70119 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977064:0:17164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c701c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977098:0:17164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c701c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977110:0:17164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c701c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977121:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c701c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977127:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c701c8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977134:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c701c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977139:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603800 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658647.977143:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c701c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977150:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c701c8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977160:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:0.0:1788658647.977162:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658647.977166:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c701c8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977172:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1ebf603800/0x48e67cc629c701c8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977182:0:17164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977194:0:17164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977199:0:17164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977204:0:17164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc177b4f0) 00010000:00010000:0.0:1788658647.977208:0:17164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977213:0:17164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977222:0:17164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:0.0:1788658647.977224:0:17164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788658647.977227:0:17164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.977232:0:17164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701ba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658647.980403:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f934723f-b66d-409a-bfc9-9b206b383163+19:15646:x1875544001094784:12345-192.168.202.53@tcp:57:lhsmtool_posix.0 Request processed in 48949us (49100us total) trans 8589934619 rc 0/0 00000100:00100000:0.0:1788658647.980419:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 62 00000020:00080000:0.0:1788658647.980426:0:17164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788658647.980747:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788658647.980753:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658647.980782:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788658647.980789:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788658647.986404:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:1.0:1788658647.986475:0:17166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001095168 00000100:00100000:1.0:1788658647.986485:0:17166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001095168 00000100:00100000:1.0:1788658647.986549:0:17166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:1.0:1788658647.986560:0:17166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f934723f-b66d-409a-bfc9-9b206b383163+19:15645:x1875544001095168:12345-192.168.202.53@tcp:49:dd.0 00000100:00100000:1.0:1788658647.986700:0:17166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f934723f-b66d-409a-bfc9-9b206b383163+19:15645:x1875544001095168:12345-192.168.202.53@tcp:49:dd.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658647.986752:0:17166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 9 00000100:00100000:3.0:1788658647.993444:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658647.993599:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001095424 00000100:00100000:2.0:1788658647.993609:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001095424 00000100:00100000:2.0:1788658647.993676:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 10 00000100:00100000:2.0:1788658647.993686:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1d8367b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+19:15646:x1875544001095424:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788658647.994002:0:17165:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788658647.994034:0:17165:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00010000:00010000:2.0:1788658647.994067:0:17165:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.994084:0:17165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.994096:0:17165:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.994104:0:17165:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.994112:0:17165:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.994119:0:17165:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658647.994144:0:17165:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788658647.994470:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1d8367b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f934723f-b66d-409a-bfc9-9b206b383163+21:15646:x1875544001095424:12345-192.168.202.53@tcp:35:lhsmtool_posix.0 Request processed in 553us (805us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788658647.994480:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 10 00000020:00080000:2.0:1788658647.994485:0:17165:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788658647.994590:0:17151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658647.994597:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.994615:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3391400 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658647.994619:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.994628:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.994642:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a1e83b21600) 00010000:00010000:0.0:1788658647.994645:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788658647.994650:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.994656:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3391400/0x48e67cc629c701cf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17165 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658647.994670:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658647.994672:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658647.994673:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658648.003887:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025291776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658648.003981:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658648.004211:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658648.004385:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001095552 00000100:00100000:2.0:1788658648.004394:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001095552 00000100:00100000:2.0:1788658648.004457:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:2.0:1788658648.004467:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+21:15645:x1875544001095552:12345-192.168.202.53@tcp:101:dd.0 00010000:00010000:2.0:1788658648.004485:0:17163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658648.004509:0:17163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd62ed6c0f1bccc96 expref: -99 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658648.004544:0:17163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658648.004558:0:17163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658648.004569:0:17163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658648.005017:0:17163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390a00/0x48e67cc629c701d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc96 expref: 23 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658648.005036:0:17163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a1eb3390c00/0x48e67cc629c701dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.53@tcp remote: 0xd62ed6c0f1bccc96 expref: 22 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658648.005059:0:17163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a1d83406100) 00010000:00010000:2.0:1788658648.005062:0:17163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788658648.005066:0:17163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a1eb3390c00, rc 0) 00000100:00100000:2.0:1788658648.005123:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f934723f-b66d-409a-bfc9-9b206b383163+22:15645:x1875544001095552:12345-192.168.202.53@tcp:101:dd.0 Request processed in 657us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658648.005131:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 63 00000100:00100000:0.0:1788658648.007194:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025291776 00000100:00100000:0.0:1788658648.007209:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025291776 00000100:00100000:0.0:1788658648.007418:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658648.007429:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875544025291776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788658648.007453:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788658648.007534:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875544025291776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (3553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658648.007541:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658648.009741:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025291776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788658648.127130:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658648.214694:0:3642:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:2.0:1788658648.215120:0:18673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001095680 00000100:00100000:2.0:1788658648.215131:0:18673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001095680 00000100:00100000:2.0:1788658648.215221:0:18673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:2.0:1788658648.215234:0:18673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f934723f-b66d-409a-bfc9-9b206b383163+7:2399:x1875544001095680:12345-192.168.202.53@tcp:4:dd.0 00002000:00010000:2.0:1788658648.215294:0:18673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9cc3d6, atime: 0x6a9cc3d5, ctime: 0x6a9cc3d6, blocks: 0x0 00010000:00010000:2.0:1788658648.215304:0:18673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c701e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658648.215319:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=565s v=(0 0) 00010000:00010000:2.0:1788658648.215324:0:18673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658648.215330:0:18673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c701e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658648.215345:0:18673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c701e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658648.218260:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658648.218928:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658648.219293:0:18675:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788658648.219304:0:18675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788658648.219784:0:18675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001095808 00000100:00100000:3.0:1788658648.219793:0:18675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001095808 00000100:00100000:0.0:1788658648.220795:0:20302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 1 00000100:00100000:0.0:1788658648.220809:0:20302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f934723f-b66d-409a-bfc9-9b206b383163+8:2399:x1875544001095808:12345-192.168.202.53@tcp:4:dd.0 00010000:00010000:0.0:1788658648.220852:0:20302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c701eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.220869:0:20302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658648.220873:0:20302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658648.220880:0:20302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c701eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.220894:0:20302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c701eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658648.323659:0:18664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1788658648.323679:0:18664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1788658648.324766:0:20302:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1788658648.324774:0:20302:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788658646 -> 1788658647 00002000:00010000:0.0:1788658648.324777:0:20302:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788658646 -> 1788658647 00002000:00010000:0.0:1788658648.324779:0:20302:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:0.0:1788658648.324797:0:20302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c701eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.324811:0:20302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c701eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.324821:0:20302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c701eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.324830:0:20302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1ebf603800 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658648.324835:0:20302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c701eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.324859:0:20302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c701eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.324878:0:20302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c701eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.324886:0:20302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d21b397/0x48e67cc629c701eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658648.325003:0:20302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f934723f-b66d-409a-bfc9-9b206b383163+7:2399:x1875544001095808:12345-192.168.202.53@tcp:4:dd.0 Request processed in 104182us (106068us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788658648.325015:0:20302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 1 00000001:00080000:1.0:1788658648.379092:0:18664:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1788658648.379574:0:18673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1788658648.379596:0:18673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c701e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.379610:0:18673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c701e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.379620:0:18673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c701e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.379628:0:18673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a1eb3390a00 already unused, calling callback (ffffffffc0b4d4f0) 00010000:00010000:0.0:1788658648.379633:0:18673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c701e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.379660:0:18673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c701e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.379680:0:18673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c701e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658648.379688:0:18673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000693de47a/0x48e67cc629c701e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658648.380288:0:18673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f934723f-b66d-409a-bfc9-9b206b383163+5:2399:x1875544001095680:12345-192.168.202.53@tcp:4:dd.0 Request processed in 165043us (165589us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788658648.380300:0:18673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 0 00000100:00100000:3.0:1788658648.510922:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788658648.510945:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb1c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025291904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658648.511029:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658648.511082:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025292032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788658648.511105:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658648.511214:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025291904 00000100:00100000:0.0:1788658648.511223:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025291904 00000100:00100000:0.0:1788658648.511282:0:17168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025292032 00000100:00100000:0.0:1788658648.511286:0:17168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025292032 00000100:00100000:0.0:1788658648.511303:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788658648.511311:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025291904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788658648.511357:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788658648.511404:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875544025291904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658648.511410:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788658648.511430:0:17168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788658648.511437:0:17168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025292032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788658648.511454:0:17168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788658648.511498:0:17168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875544025292032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658648.511504:0:17168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788658648.511723:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb1c9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875544025291904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788658648.511738:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875544025292032:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788658649.152082:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788658649.921082:0:20339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:1.0:1788658650.047528:0:17196:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788658650.047539:0:17196:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658650.047557:0:17196:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788658650.047566:0:17196:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788658650.175825:0:17150:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658651.070966:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658651.070994:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025292160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658651.071072:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658651.071136:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025292160 00000100:00100000:0.0:1788658651.071144:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025292160 00000100:00100000:0.0:1788658651.071204:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788658651.071214:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025292160:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788658651.071399:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788658651.073321:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788658651.073422:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875544025292160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2206us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658651.073433:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788658651.073629:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb2252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025292288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658651.073672:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658651.073754:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875544025292160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788658651.073792:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025292288 00000100:00100000:0.0:1788658651.073798:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025292288 00000100:00100000:0.0:1788658651.073843:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788658651.073852:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025292288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658651.073873:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788658651.073907:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875544025292288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658651.073913:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788658651.073943:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658651.073967:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb2252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875544025292288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658651.081972:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025292416:0@lo:400:kworker.0 00000100:00100000:0.0:1788658651.082046:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658651.082144:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025292416 00000100:00100000:2.0:1788658651.082169:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025292416 00000100:00100000:2.0:1788658651.082231:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788658651.082256:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3647:x1875544025292416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658651.083235:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:913293d7-fe00-4834-a4c1-1b0cae17d59a+24:3647:x1875544025292416:12345-0@lo:400:kworker.0 Request processed in 991us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658651.083307:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788658651.083356:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025292544:0@lo:400:kworker.0 00000100:00100000:2.0:1788658651.083932:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658651.084031:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:913293d7-fe00-4834-a4c1-1b0cae17d59a:3647:1875544025292416:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.084758:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658651.084770:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025292928:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.084815:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658651.084862:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025292672:0@lo:400:kworker.0 00000100:00100000:0.0:1788658651.084894:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658651.084917:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658651.084922:0:3649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025292800:0@lo:400:kworker.0 00000100:00100000:0.0:1788658651.084945:0:3649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658651.084975:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025292672 00000100:00100000:0.0:1788658651.084982:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025292672 00000100:00100000:0.0:1788658651.085038:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658651.085047:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025292672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658651.085098:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875544025292672:12345-0@lo:400:kworker.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658651.085105:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658651.085127:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025292800 00000100:00100000:0.0:1788658651.085130:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025292800 00000100:00100000:0.0:1788658651.085155:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788658651.085162:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb1c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025292800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658651.085189:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb1c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875544025292800:12345-0@lo:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658651.085195:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788658651.085215:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658651.085234:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875544025292800:0@lo:400:kworker.0 00000100:00100000:0.0:1788658651.085275:0:3649:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1788658651.085280:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a1eb2250380, transno 8589934596 00000004:00080000:0.0:1788658651.085290:0:3649:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788658651.085310:0:3649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875544025292672:0@lo:400:kworker.0 00000100:00100000:1.0:1788658651.088727:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025292544 00000100:00100000:1.0:1788658651.088741:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025292544 00000100:00100000:1.0:1788658651.088796:0:17167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025292928 00000100:00100000:1.0:1788658651.088799:0:17167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025292928 00000100:00100000:1.0:1788658651.088816:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788658651.088825:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb2251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025292544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658651.088920:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb2251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875544025292544:12345-0@lo:400:kworker.0 Request processed in 97us (4989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658651.088927:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788658651.088945:0:17167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788658651.088951:0:17167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025292928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658651.088976:0:17167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025292928:12345-0@lo:400:kworker.0 Request processed in 27us (4162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658651.088981:0:17167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788658651.089454:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025292928:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.089479:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875544025292544:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.093734:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025293056:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.093816:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658651.093909:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025293056 00000100:00100000:3.0:1788658651.093917:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025293056 00000100:00100000:3.0:1788658651.093988:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788658651.093997:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025293056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094051:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875544025293056:12345-0@lo:400:kworker.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658651.094058:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788658651.094075:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658651.094098:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875544025293056:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094139:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658651.094145:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025293184:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094164:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658651.094196:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025293312:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094217:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658651.094256:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025293184 00000100:00100000:3.0:1788658651.094260:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025293184 00000100:00100000:3.0:1788658651.094286:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025293312 00000100:00100000:3.0:1788658651.094289:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025293312 00000100:00100000:3.0:1788658651.094315:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788658651.094322:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025293184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094352:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875544025293184:12345-0@lo:400:kworker.0 Request processed in 31us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658651.094356:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788658651.094388:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788658651.094394:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025293312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094424:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875544025293312:12345-0@lo:400:kworker.0 Request processed in 31us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658651.094430:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788658651.094445:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658651.094464:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875544025293312:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094474:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875544025293184:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094502:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788658651.094508:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025293440:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094530:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658651.094556:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025293440 00000100:00100000:3.0:1788658651.094559:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025293440 00000100:00100000:3.0:1788658651.094587:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788658651.094592:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025293440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094616:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875544025293440:12345-0@lo:400:kworker.0 Request processed in 24us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658651.094620:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788658651.094628:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788658651.094640:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377e300 x1875544025293440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658651.094647:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875544025293440:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094666:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025293568:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094680:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658651.094695:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025293568 00000100:00100000:3.0:1788658651.094721:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025293568 00000100:00100000:3.0:1788658651.094742:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788658651.094746:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025293568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094770:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb377d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875544025293568:12345-0@lo:400:kworker.0 Request processed in 24us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658651.094774:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788658651.094782:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658651.094792:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875544025293568:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094810:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658651.094813:0:3650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025293696:0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094828:0:3650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658651.094840:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544025293696 00000100:00100000:3.0:1788658651.094842:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544025293696 00000100:00100000:3.0:1788658651.094856:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788658651.094859:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025293696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658651.094878:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875544025293696:12345-0@lo:400:kworker.0 Request processed in 18us (49us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658651.094881:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788658651.094889:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788658651.094898:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8a1eb377e300 x1875544025293696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658651.094904:0:3650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a1eb377e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875544025293696:0@lo:400:kworker.0 00010000:00010000:1.0:1788658651.214137:0:17151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658651.325490:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658651.325527:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658651.325567:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658651.325592:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658651.325634:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658651.325654:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658651.325671:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658651.325688:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658651.325739:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.53@tcp (source: 12345-192.168.202.53@tcp) 00000100:00100000:3.0:1788658651.325767:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001096448 00000100:00100000:3.0:1788658651.325776:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001096448 00000100:00100000:3.0:1788658651.325829:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001096960 00000100:00100000:3.0:1788658651.325832:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001096960 00000100:00100000:3.0:1788658651.325845:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001096320 00000100:00100000:3.0:1788658651.325847:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001096320 00000100:00100000:3.0:1788658651.325860:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001096832 00000100:00100000:3.0:1788658651.325862:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001096832 00000100:00100000:3.0:1788658651.325877:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1788658651.325888:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f934723f-b66d-409a-bfc9-9b206b383163+5:2396:x1875544001096448:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658651.325958:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f934723f-b66d-409a-bfc9-9b206b383163+5:2396:x1875544001096448:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 73us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658651.325966:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 22 00000100:00100000:3.0:1788658651.325984:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:3.0:1788658651.325990:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2396:x1875544001096960:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658651.326016:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2396:x1875544001096960:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658651.326023:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 23 00000100:00100000:3.0:1788658651.326034:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:3.0:1788658651.326041:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f934723f-b66d-409a-bfc9-9b206b383163+5:2396:x1875544001096320:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658651.326080:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f934723f-b66d-409a-bfc9-9b206b383163+5:2396:x1875544001096320:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 39us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658651.326095:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 24 00000100:00100000:3.0:1788658651.326108:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:3.0:1788658651.326115:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2396:x1875544001096832:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:3.0:1788658651.326139:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2396:x1875544001096832:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658651.326146:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 25 00000100:00100000:3.0:1788658651.326176:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001096192 00000100:00100000:3.0:1788658651.326180:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001096192 00000100:00100000:3.0:1788658651.326366:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001096704 00000100:00100000:3.0:1788658651.326371:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001096704 00000100:00100000:0.0:1788658651.326484:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001095936 00000100:00100000:0.0:1788658651.326489:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001095936 00000100:00100000:0.0:1788658651.326598:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 170 00000100:00100000:0.0:1788658651.326606:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb3674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2396:x1875544001095936:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:0.0:1788658651.326634:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb3674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:67137b4e-5d5d-4374-acb2-2bfe6af790cf+13:2396:x1875544001095936:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 30us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658651.326641:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 170 00000100:00100000:2.0:1788658651.331355:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001096064 00000100:00100000:2.0:1788658651.331372:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001096064 00000100:00100000:2.0:1788658651.331419:0:20300:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544001096576 00000100:00100000:2.0:1788658651.331423:0:20300:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544001096576 00000100:00100000:2.0:1788658651.331446:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:2.0:1788658651.331455:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+5:2396:x1875544001096192:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658651.331529:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+5:2396:x1875544001096192:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 75us (6000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658651.331536:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 68 00000100:00100000:2.0:1788658651.331553:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:2.0:1788658651.331559:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2396:x1875544001096704:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658651.331582:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+5:2396:x1875544001096704:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 24us (5989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658651.331588:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 69 00000100:00100000:2.0:1788658651.331598:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:2.0:1788658651.331604:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+22:2396:x1875544001096064:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658651.331629:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f934723f-b66d-409a-bfc9-9b206b383163+22:2396:x1875544001096064:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 25us (5974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658651.331642:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 70 00000100:00100000:2.0:1788658651.331655:0:20300:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00100000:2.0:1788658651.331661:0:20300:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8a1eb5eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2396:x1875544001096576:12345-192.168.202.53@tcp:400:kworker.0 00000100:00100000:2.0:1788658651.331684:0:20300:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8a1eb5eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd2cc7e4-86ae-478d-8d87-40bfe6d9ffad+6:2396:x1875544001096576:12345-192.168.202.53@tcp:400:kworker.0 Request processed in 23us (5996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658651.331689:0:20300:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.53@tcp, seq: 71 00000100:00080000:3.0:1788658651.332741:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658651.332749:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788658651.332752:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658651.332754:0:17158:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 Debug log: 43012 lines, 43012 kept, 0 dropped, 0 bad.